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The  usual  mathematical  formulation  of  availability 
assumes  an  exponential  distribution  for  failure  and  repair 
times.  While  such  an  assumption  is  sometimes  correct  for 
reliability,  it  is  not  valid  for  maintainability.  This 
study  was  conducted  primarily  in  order  to  verify  that  the 
lognormal  distribution  is  a suitable  descriptor  for  correc- 
tive maintenance  repair  times,  and  to  estimate  the  error 
caused  in  assuming  an  exponential  distribution  for  avail- 
ability and  maintainability  calculations  when  in  fact  the 
distribution  is  lognormal.  Approximately  20  sets  of  exist- 
ing maintainability  demonstration  repair  time  data,  of 
essentially  electronic  systems,  were  analyzed  using  the 
methods  of  probability  plotting  and  statistical  testing  for 
distributional  assumption.  The  results  show  that  the  log- 
normal distribution  assumption  cannot  be  rejected  in  most 
of  the  cases,  while  the  exponential  distribution  is  re- 
jected. However,  the  error  caused  when  assuming  an  expo- 
nential distribution  for  MTTR  is  found  to  be  negligible. 
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I.  INTRODUCTION 


A.  OVERVIEW 

The  effectiveness  of  a system  depends  not  only  on  its 
ability  to  meet  its  specified  performance  requirements,  but 
also  on  its  ability  to  perform  when  needed,  for  the  dura- 
tion of  its  assigned  missions,  and  for  its  operational 
lifetime. 

The  technical  disciplines  concerned  with  these  time- 
related  system  characteristics  are  reliability,  maintain- 
ability and  logistics.  These  are  related  mathematically  by 
the  concepts  of  availability,  dependability  and  operational 
readiness. 

In  order  to  achieve  these  performance  requirements  in 
the  design  of  a system,  it  should  be  possible  to  translate 
them  into  measurable  quantitative  parameters,  and  then,  to 
demonstrate  their  results  during  the  system  acceptance 
testing. 

The  usual  mathematical  formulation  of  availability, 
when  derived  from  calculus,  assumes  an  exponential  distri- 
bution for  failure  and  repair  times.  While  such  an  assump- 
tion is  sometimes  correct  for  reliability,  it  is  not  valid 
for  maintainability  since  a repair  time  distribution  must 
start  with  a value  of  zero  for  repair  time,  and  not  with 
its  maximum  value,  at  time  t=Q.  No  repairs  can  be  made  in 
zero  time.  In  fact,  there  appears  to  be  overwhelming 
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evidence  that  the  lognormal  distribution  is  the  "best"  de- 
scriptor for  corrective  maintenance  repair  times. 

The  logarithmic  normal  density  function  as  a repair 
time  distribution  is  characterized  by  a value  of  zero  at 
time  t=0,  rises  to  its  maximum  value  in  a reasonably  short 
time,  and  gradually  decreases  towards  zero  as  repair  times 
increases  [Refs.  1 and  21.  Military  standards  for  predic- 
tion and  demonstration  of  maintainability  generally  are 
based  on  the  assumption  of  the  lognormal  distribution  [Ref. 

3] . However,  field  data  has  shown  that  repair  times  are 
usually  longer  than  specified,  predicted,  or  demonstrated. 
While  part  of  this  can  be  attributed  to  differences  between 
the  design,  the  testing,  and  the  field  environment,  part  of 
it  is  also  due  to  incorrect  assumptions  or  faulty  analytic 
techniques  in  the  evaluation  of  the  repair  time. 

In  order  to  help  in  focusing  attention  on  these  matters, 
a statistical  analysis  on  data  sets  of  demonstrated  repair 
times  has  been  conducted  as  part  of  a preliminary  study  on 
the  application  of  the  lognormal  distribution  to  corrective 
maintenance  downtime.  The  results  of  the  analysis  are 
given  in  this  thesis. 

B.  PURPOSE  AND  APPROACH 

1.  Objectives 

The  objectives  of  this  study  have  been  — (1)  to 
verify  that  the  lognormal  distribution  is  a suitable  descrip- 
tor for  corrective  maintenance  repair  times,  (2)  to  estimate 
the  percentage  error  caused  in  assuming  an  exponential 
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distribution  for  availability  and  maintainability  calcula- 
tions when  in  fact  the  distribution  is  lognormal,  (3)  to 
test  the  lognormal  and  exponential  distributions  for  sys- 
tems and  equipments  in  which  new  technologies  in  micro- 
circuitry and  computation  are  used  to  increase  reliability 
and  decrease  diagnostic  time,  (4)  to  determine  expected 
ranges  of  the  principal  distribution  parameters  for  differ- 
ent classes  of  equipment,  (5)  to  test  the  lognormal  and 
exponential  distributions  against  mechanical  and  other 
non-electronic  systems. 

2.  Systems  and  Data  Analyzed 

Approximately  20  sets  of  existing  maintainability 
demonstration  repair  time  data  for  essentially  electronic 
systems/equipments,  were  accumulated.  Some  of  the  data 
sets  were  obtained  from  published  papers  and  reports.  De- 
tailed reports  were  provided  by  the  Maintainability 
Assurance  Branch  of  the  Engineering  Services  Division  of 
Ford  Aerospace  and  Communications  Corporation. 

The  systems/equiprcent  analyzed  and  their  sources 
are  discussed  in  Section  IV.  They  range  from  1950 ' s-1960 ' s 
systems  representative  of  primarily  analog,  vacuum  tube, 
discrete  component  design  to  some  1970's  systems  using 
digital,  transistor /microelectronics  design  with  extensive 
built-in  test  and  modular  replacement  maintainability  de- 
sign features. 

The  repair  times  were  reviewed  for  conditions  under 
which  taken,  accuracy,  and  specific  data  points  which  could 
cause  bias  in  the  analysis. 
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3.  Analysis  Approach 

Two  different  approaches  to  assess  the  reasonable- 
ness of  a selected  distribution  on  the  basis  of  given  data 
were  considered.  These  two  techniques  are  (1)  probability' 
plotting,  and  (2)  statistical  testing  for  distributional 
assumptions. 

Although  these  techniques  were  used  primarily  to 
test  the  assumption  of  the  lognormal  distribution  for  cor- 
rective maintenance  repair  time,  the  exponential  distribu- 
tion, often  assumed  in  theory,  was  also  tested  in  order  to 
verify  its  validity  for  repair  times. 

The  following  procedure  was  used  for  analyzing  the 

dat  a : 

(a)  The  data  were  plotted  on  lognormal  probability  paper 
and  the  "best  fit"  line  drawn. 

(b)  A chi-squared  goodness-of-f it  test  [Ref.  4]  was  per- 
formed for  the  lognormal  and  the  exponential  distri- 
bution, using  a computer  program  prepared  for  the 
analysis. 

(c)  Another  test,  due  to  Shapiro  and  Wilk  [Refs.  4 and 

5] , called  the  W-test  was  used  to  test  the  assumption 
for  the  lognormal  distribution  for  samples  of  size 
less  than  or  equal  to  50  (due  to  availability  of 
tables) . 

(d)  In  those  cases  where  the  analysis  indicated  close 
results  for  both  the  lognormal  and  exponential  dis- 
tribution assumptions,  or  when  the  exponential 


distribution  appeared  to  be  appropxiate,  a plot  of 
the  data  on  chi-square  probability  paper  (two  de- 
grees of  freedom),  which  represents  the  exponential 
distribution,  was  made.  Histograms  were  prepared 
in  some  of  these  cases. 

The  computer  program  prepared  for  the  analysis 
makes  use  of  appropriate  routines  from  the  International 
Mathematical  and  Statistical  Library  (IMSL)  for  the  chi- 
squared  test . The  program  calculates  from  the  data  such 
parameters  as  the  mean,  variance,  and  percentiles  (in  this 
case  the  50th,  90th,  and  95th)  for  the  exponential  and  log- 
normal distributions,  which  are  defined  in  the  program. 

It  also  computes  the  percentage  difference  for  each  para- 
meter for  comparison  purposes,  and  it  is  used  to  compute 
and  print  out  the  approximate  frequencies  (expected  value 
of  the  ordered  observations)  for  plotting  purposes. 

The  theory  and  concepts  related  to  corrective  main- 
tenance repair  time  are  given  in  Section  II,  in  which  the 
relationship  between  time  to  repair  and  the  effectiveness 
of  a system  is  considered. 

Statistical  considerations,  which  include  a descrip- 
tion of  the  statistical  distributions,  probability  plotting, 
and  testing  of  distributional  assumptions  is  given  in 
Section  III.  This  describes  the  theory  related  to  the 
analysis.  Section  III  also  includes  a description  of  the 
analysis  process  and  the  major  functions  of  the  computer 
program  used  in  it.  A more  detailed  description  of  the 
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program,  its  major  subroutines,  and  a definition  of  the 
input  data  formats  is  given  in  Appendix  F. 

The  reports  from  which  the  data  sets  were  taken  are 
discussed  in  Section  IV.  The  final  two  sections  include 
the  results  of  the  analysis,  a discussion  of  some  of  the 
cases  and  their  results,  and  the  conclusions  reached  based 
on  the  analysis.  Recommendations  regarding  continuing  re- 
search are  presented  at  the  end  of  Section  VI. 


II.  CORRECTIVE  MAINTENANCE  REPAIR  TIME 
AND  RELATED  CONCEPTS 

A.  CONCEPTS  OF  SYSTEM  EFFECTIVENESS 

System  effectiveness  is  a measure  of  how  well  a system 
performs  its  intended  functions  and  its  ability  to  be  re- 
tained in  or  restored  to  an  effective  usable  condition. 

In  other  words,  system  effectiveness  is  concerned  with  the 
availability  of  the  system  to  perform  its  mission  success- 
fully in  its  intended  environment  ERef . 6] . 

Because  there  are  many  semantic  difficulties  in  talking 
of  the  system  effectiveness  and  the  relationship  between 
its  components  (Figure  1),  the  following  terms  are  general- 
ly recognized  components  of  system  effectiveness  [Ref.  6]: 

(a) -  The  performance  capability  of  the  system. 

(b) -  The  operational  readiness  or  availability  of  the 

system,  that  is,  its  ability  to  start  performance 
of  a mission  when  called  upon  to  do  so. 

(c) -  The  system  dependability , or  its  mission  reliability, 

that  is,  its  continued  capability  to  perform. 

Figure  1 shows  that  maintainability  (downtime)  contri- 
butes its  part  to  availability , which  together  with  opera- 
tional readiness  are  components  of  system  effectiveness. 

This  concept  of  system  effectiveness,  one  among  various  con- 
cepts which  have  been  developed,  was  delinated  by  personnel 
of  ARINC  Research  Corporation  (Ref.  7].  Basically,  the 


I 


I 


i 


£ 

£ 

$ 


17 


MMtlJjg 


•mi* 


©3 


Storage 

Time 


vailability 


Free 

Time 


Operating 

Down 

Time 

Time 

(Reliability) 

(Mainxainability ) 

ii 


m 


Active  Repair 
Time 


Intrinsic 

Availability 


Logistic 

Time 


Serviceability 


Adrainist rat ive 
Time 


Concepts  Associated  with  Systems 
Effectiveness  [Ref.  7] 


1 


»• 


components  of  system  effectiveness  are  probabilities,  which, 
combined  together  with  time  measures  and  environmental  con- 
ditions, define  the  system's  ability  to  perform  successfully 
when  needed. 

B.  AVAILABILITY  AND  MAINTAINABILITY  CONSIDERATIONS 

Availability  is  a measure  which  relates  reliability  and 
maintainability  to  operational  readiness.  In  some  cases, 
availability  and  operational  readiness  have  been  considered 
to  be  the  same.  These  are  all  requirements  which  must  be 
satisfied  during  the  design  of  a system,  and,  thus,  have  to 
be  quantitatively  evaluated. 

1.  Availability 

There  are  a variety  of  ways  of  expressing  avail- 
ability. In  general,  availability  relates  "uptime"  (relia- 
bility) to  "downtime"  (maintainability),  and  it  may  be  de- 
fined as  the  ratio  between  the  time  the  system  is  capable 
of  performing  its  mission  to  the  total  time  the  system  is 
in  operational  demand. 

The  two  expressions  of  availability  of  greatest  con- 
cern are — (1)  inherent  availability  (A^),  and  (2)  opera- 
tional availability  (Aq).  The  latter,  which  includes  in 
the  calculation  of  the  availability  ratio  all  the  delay 
times  and  the  actual  active  downtime  (Figure  1),  including 
preventive  maintenance  is  beyond  control  of  the  system 
designer  or  producer.  Therefore,  the  inherent  availability, 
which  is  a hardware  oriented  measure,  is  the  one  which  is 
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usually  specified  and  required  within  the  maintainability  ' 
contract  requirements. 

a.  Inherent  Availability  (A^) 

Inherent  availability,  which  includes  only  in- 
trinsic design  variables  controllable  by  the  system  de- 
signer, may  be  expressed  as: 


MTBF 

1 “ MTBF  + MTTR 


(1) 


where 

MTBF  = Mean  Time  Between  Failures 
MTTR  = Mean  Time  To  Repair 

It  may  be  defined  as  the  probability  that  a sys- 
tem, when  used  under  stated  conditions,  without  considera- 


tion of  any  scheduled  or  preventive  action,  and  in  an  ideal 
support  environment,  will  operate  satisfactorily  at  any  given 
time  [Ref. *8], 


b.  Operational  Availability  (Aq) 


Operational  availability,  which  includes  all  the 
delay  times  as  part  of  the  downtime  (Figure  1),  may  be  ex- 
pressed as: 


A = 
o 


MTBM 


MTBM  + MDT 


(2) 


where 


MTBM  = Mean  Time  Between  Maintenance 
MDT 


Mean  Down  Time  (Including  supply  and  adminis- 
trative delays  and  actual  active-corrective 
and  preventive  maintenance-downtime,  during 
the  same  time  interval) 
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It  may  be  defined  as  the  probability  that  a sys- 
tem, when  used  under  stated  conditions  and  in  an  actual 
supply  environment,  will  operate  satisfactorily  at  any  given 
time  [Ref.  8] . 

2.  Maintainability 

Maintainability  is  a characteristic  of  system  design 
which  determines  the  ability  to  keep  an  operating  system  in 
operation  (preventive  maintenance),  or  to  restore  it  to  a 
usable  condition  (corrective  maintenance).  It  is  defined  in 
MIL-STD-721B  [Ref.  9]  as  "....the  probability  that  an  item 
will  be  retained  in  or  restored  to  a specific  condition 


within  a given  period  of  time,  when  the  maintenance  is  per- 
formed in  accordance  with  prescribed  procedures  and  resources." 

From  its  definition,  maintainability  is  concerned 
with  both  preventive  and  corrective  maintenance.  However, 
many  of  the  critical  problems  are  related  to  corrective 
maintenance,  since  this  involves  a "repair"  action,  often 
during  a mission  and  within  a relatively  short  period  of  time. 
Therefore,  time,  as  a critical  factor  in  corrective  mainte- 
nance, is  an  important  parameter  in  maintainability  design 


which  should  be  directed  such  that  the  maintenance  task  times 
will  be  minimized.  The  extent  to  which  the  time  factor  is 


considered  during  design  depends  on  the  ability  to  predict, 
allocate,  and  demonstrate  its  quantitative  value.  In  order 
to  do  this,  statistical  methods  are  used  for  prediction  and 
evaluation.  Some  of  them  are  based  on  the  assumption  of  an 
underlying  distribution  of  the  repair  time,  and  others  are 
"distribution  free"  methods. 
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a.  MTTR  in  Corrective  Maintenance 

The  system  downtime,  from  failure  occurrence 
to  system  restoration  to  an  operating  condition,  usually 
includes  corrective  and  preventive  maintenance  downtimes 
and  delay  times.  The  delay  or  waiting  time  includes  ad- 
ministrative time  and  supply  time,  which  to  a large  extent, 
are  not  design  controllable. 

The  Mean  Time  to  Repair  (MTTR),  a parameter 
often  used  for  maintainability  prediction  and  maintain- 
ability demonstration,  is  defined  in  MIL-STD-721B  [Ref.  9] 
as  the  total  corrective  maintenance  time  divided  by  the 
total  number  of  corrective  maintenance  actions  during  a 
given  period  of  time.  Further,  the  repair  time  consists  of 
the  actions  required  to  perform  on-line  repair  of  a failed 
item  of  equipment.  These  actions,  called  corrective  mainte- 
nance tasks,  may  be  separated  into  four  sequential  time 
phases  as  follows  [Ref.  10] : 

(a)  Detection  time  - the  time  to  detect  or  to  recognize 

the  existence  of  a fault. 

(b)  Diagnostic  time  - the  time  to  localize  and  to 

isolate  the  fault. 

(c)  Corrective  time  - the  time  to  remove  and  replace  the 

item  or  to  repair  it. 

(d)  Verification  time  - the  time  to  verify,  by  testing 
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and  alignment,  that  the  fault  has  been  corrected* 
The  corrective  maintenance  downtime  may  also  be  divided  into 
two  steps,  the  first  consisting  of  the  detection  time  and 
the  second  of  the  active  repair  time,  which  includes  the 
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remaining  three  phases  of  corrective  maintenance  as  illus- 
trated in  Figure  2.  Active  repair  time  can  usually  be  de- 
scribed by  a statistical  distribution  and  its  mean,  the 
MTTR,  can  be  estimated  by  statistical  methods, 
b.  Maintainability  Demonstration 

Maintainability  Demonstration  is  a specific  test 
program  to  be  performed,  as  part  of  system  acceptance  test- 
ing. Such  a demonstration  determines  the  degree  to  which 
the  specified  maintainability  requirements  have  been  met. 

MIL-STD-471A  [Ref.  3]  provides  methods  for  demon- 


strating repair  time  parameters,  such  as,  MTTR,  M 

IQEX 

allowable  maximum  maintenance  time,  I ^ - mean  preventive 
maintenance  time  and  the  median  of  the  repair  time  distribu- 


tion. 


3 - mean  corrective  maintenance  time, 


referenced  in 


MIL-STD-471A  [Ref.  3] , is  the  same  parameter  as  MTTR. 


Based  on  References  8 and  10,  the  most  used 


test  methods  in  MIL-STD-471A  for  repair  time  parameters  are 
methods  4,  8 and  9.  These  are  summarized  in  Appendix  A. 
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'igure  2:  Major  Events  and  Activities  Comprising 
Corrective  Maintenance  [Ref.  10] 
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III.  STATISTICAL  CONSIDERATION 

A.  STATISTICAL  DISTRIBUTIONS 

1 . The  Lognormal  Distribution 

A random  variable  is  said  to  have  a logarithmic  nor- 
mal distribution  (lognormal)  if  the  logarithm  of  the  vari- 
able is  normally  distributed,  with  parameters  y and  a. 

The  normal  probability  density  function  for  y is: 

(y-u)2 

g(y)  = — e 2°  , -oo  < y < co  (3) 

a/2? 

where  y and  a are  the  expected  value  and  the  standard  devia- 
tion of  y,  respectively. 

The  lognormal  probability  density  function  for  the 
variable  x (y  = In  x)  is  [Refs.  1 and  2] : 

^ (In  x-y)2 

f(x)  = —2—  e x > 0 (4) 

crx/2TT 

where  y = In  x , -»  < y < 00 

2 

and  a = var(ln  x)  a > 0 

This  distribution  has  many  different  shapes  for  non- 
negative variates.  It  is  skewed  to  the  right,  the  degree 
of  skewness  increasing  with  increasing  values  of  a.  y and  a 
are  scale  and  shape  parameters  respectively  and  not  location 
and  scale  parameters  as  in  the  normal  distribution. 
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The  lognormal  distribution  has  been  shown  to  be  ap- 
plicable to  many  economic  and  biologic  processes,  when  the 
observed  value  is  a random  proportion  of  the  previous  value. 
It  is  also  applicable  when  the  geometric  mean  better-  de- 
scribes the  central  tendency  of  the  distribution  rather 
than  the  arithmetic  mean  [Refs.  1 and  2], 

2.  Estimation  of  the  Lognormal  Distribution  Parameters 
Parameters  of  statistical  distributions  can  be  de- 
rived analytically  using  standard  statistical  techniques. 

The  lognormal  distribution,  in  its  simplest  form, 
is  a two-parameter  distribution,  u and  a.  These  are  esti- 
mated as  follows  [Ref.  4] : 


■ k z <in  v 


i=l 


(5) 


(6) 


It  can  be  shown  [Refs.  1 and  2]  that  if  x and  v 

q q 

2 

are  the  percentiles  of  order  q of  x(u,o  ) and  of  z(0,l), 
the  standardized  normal  distribution,  then 


Xq  * e 


V+V 


(7) 


From  equation  (7),  the  following  relations  hold: 


Mode : 


Median: 

X0.5 

e^ 

Mean : 

Xm  = 

y+0.5c2 

e 

90th  Percentile: 

X0 . 9 " 

eM+1.282a 

95th  Percentile: 

X0 . 95  = 

u+1.645a 

I Figure  3 shows  the  lognormal  distribution  and  its  signifi- 

cant parameters. 

The  parameters  of  the  lognormal  distribution  can 
also  be  derived  from  a straight  line  obtained  from  and 
fitted  to  data  points  plotted  on  lognormal  graph  paper 
[Ref.  111. 

/\ 

* . The  estimate  of  the  parameter  u,u,  is  found  first 

by  entering  the  plot  at  the  50th  percent  point  on  the  pro- 

i 

| bability  scale  of  the  paper,  and  by  reading  the  value  of 

I the  variable  on  the  other  scale.  The  natural  logarithm  of 

1 

I this  value,  which  is  the  estimate  of  the  median  of  the 

\ 

j distribution  function,  is  the  estimate  of  u. 

r 

The  estimate  of  a is  found  in  two  steps.  First  the 
value  of  the  natural  logarithm  of  the  84th  percentile, 
xQ  g4,  is  found,  then  the  estimate  of  a is  the  difference 
between  In  Xq  g4  and  u. 

3.  The  Exponential  Distribution 

The  probability  density  function  of  the  exponential 
distribution  is  [Ref.  41 

j —AX 

f (x,A)  = Ae  AX  , x > 0,  A > 0 ’ (8) 
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Its  cumulative  distribution  function  is 


x 

F(x,X)  = J Xe"Xt  dt  = 1 - e~Xx  , (9) 

o 

which  can  be  easily  evaluated. 

The  exponential  distribution  is  used  frequently  as 
a time-to-f ailure  model  for  a system  when  a constant 
failure  rate  is  assumed  [Ref.  4] . But  for  the  case  of  repair 
times,  it  can  be  shown  heuristically  that  it  is  not  an 
appropriate  model.  Because  repair  time  includes  diagnostic, 
correction,  and  verification  tasks,  involving  time,  a re- 
pair time  distribution  must  have  a value  of  zero  at  time  t=0, 
increases  to  its  maximum  value  rapidly  and  then  gradually 
decreases  towards  zero  as  time  increases.  However,  an 
exponential  distribution  suggests  that  the  maximum  number 
of  repairs  can  be  made  in  zero  time.  When  repair  times  are 
clustered  or  grouped  into  intervals  (e.g.  histograms),  the 
result  may  appear  to  fit  an  exponential  distribution. 

The  estimator  of  the  parameter  X of  the  exponential 
distribution  from  given  data  is 


i=l 

The  parameter  of  the  exponential  distribution  can 
also  be  derived  from  data  plotting  on  chi-square  (two  de- 
grees of  freedom)  probability  paper,  by  reading  the  value 
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The  expo- 


of the  variable  at  the  50th  percent  point,  Xq  g. 
nential  cumulative  distribution  function  (9),  for  xQ  5 is 

-Ax, 


F^x0.5’  = 1 ” 


k0.5 


thus 


A * - 


In  0.5  _ 0.693 


0. 5 


0.5 


The  estimation  of  other  percentiles,  like  the  90th 
and  the  95th  which  are  often  used  for  allowable  maximum 
repair  time,  can  also  be  derived  from  (10)  and  the  estima- 
tor of  A . 

For  example,  the  90th  percentile  is 


0 . 9 


or 


x 


0.9 


In  0.1  _ 2J3 

A /V 

A A 


■fe-TT-g  , = 3.32  x.  , 
In  0 . 5 0.5  0.5 


B.  PROBABILITY  PLOTTING  AND  TESTING  OF 
DISTRIBUTIONAL  ASSUMPTIONS 

1 . Probability  Plotting 

Plotting  data  points  on  probability  paper  is  quite 
simple  and  does  not  require  complicated  calculations  or  the 
use  of  statistical  tables.  According  to  Hahn  and  Shapiro 
(Ref.  43 , "Probability  plotting  is  a subjective  method  in 
that  the  determination  of  whether  or  not  the  data  contradict 
the  assumed  model  is  based  on  a visual  examination,  rather 


than  a statistical  calculation." 


The  only  calculation 


needed  is  that  of  the  expected  values  of  the  ordered  obser- 
vations, which  approximate  the  cumulative  distribution 
function.  (A  more  detailed  discussion  of  the  expected  value 
of  an  ordered  observation  is  given  in  Appendix  B.) 

As  mentioned  in  the  previous  section,  a plot 
of  the  data,  when  it  fits  the  assumed  probability  distri- 
bution, can  provide  estimates  of  the  percentiles  of  the 
distribution  and  its  parameters. 

When  plotting  the  data  on  special  graph  paper  de- 
signed for  the  assumed  distribution,  and  if  the  assumed 
distribution  is  correct,  the  plotted  points  will  tend  to 
fall  in  a straight  line  except  for  extreme  value  points, 
discussed  in  Section  VC.  _ If  the  assumption  is  inadequate, 
the  plot  will  not  be  linear;  the  variations  of  the  data 
points  from  a straight  line  will  be  significant  [Refs.  4, 

11  and  12] . 

The  selection  of  the  appropriate  distribution 
should  be  based  on  an  understanding  of  the  underlying  physi- 
cal phenomena. 

In  this  study,  the  lognormal  distribution  is  assumed 
to  be  the  underlying  distribution  for  corrective  maintenance 
repair  times  and  therefore  logarithmic  normal  probability 
paper  was  used.  The  assumption  of  the  exponential  distri- 
bution and  the  use  of  chi-square  (two  degrees  of  freedom) 
probability  paper,  were  only  made  where  the  statistical  tests 
indicated  close  results  for  both  distribution  assumptions, 
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or  where  other  considerations  indicated  that  the  exponen- 
tial distribution  appeared  to  be  appropriate. 

If  the  plot  deviates  significantly  from  a straight 
line,  the  assumed  distribution  does  not  adequately  describe 
the  data.  Systematic  deviations  are  indication  that  the 
model  is  inadequate.  The  determination  of  what  can  or  cannot 
be  considered  a straight  line  is  a subjective  matter.  The 
larger  the  sample  size  and  the  greater  the  divergence  from 
the  assumed  distribution,,  the  easier  it  is  to  detect  non- 
random  deviations. 

In  most  statistical  texts,  the  method  of  least 
squares  is  suggested  for  fitting  a straight  line  to  plotted 
data.  However,  fitting  "by  eye"  may  be  sufficient  because 
in  the  end  a subjective  decision  on  whether  or  not  the 
assumed  model  is  adequate  must  still  be  made.  Furthermore, 
the  method  of  least  squares  is  not  appropriate  in  the  case 
of  probability  plotting,  because  the  ordered  observations 
are  not  independent.  The  procedure  for  preparing  a proba- 
bility plot  from  a given  set  of  data  involves  ranking  of 

the  observations  in  ascending  order  and  plotting  the  i-th 

( i-i) 

ordered  value  versus  ■■  — x 100,  which  is  the  expected 
value  of  the  i-th  observation.  Thus,  there  is  a constraint 
that  x^+^  >_  x^  for  all  i,  and  therefore  the  ordered  observa- 
tions are  not  independent  (see  Appendix  B). 

Figures  4 and  5 readily  illustrate  the  capability 
of  probability  plots  to  give  a quick  indication  of  the 
suitability  of  a distribution. 
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Figure  4:  Lognormal  Probability  Plot  of  Lognormally 
Distributed  Data  [Set  No.  19] 


2.  Tests  for  Distributional  Assumptions 

The  second  technique  which  has  been  used  in  order 
to  analyze  the  assumption  about  the  lognormal  distribution 
is  statistical  test  of  significance.  Such  a test  of  a dis 
tributional  assumption  provides  an  objective  technique,  to 
some  extent,  for  assessing  whether  or  not  an  assumed  model 
provides  an  adequate  description  of  observed  data. 

There  are  three  basic  steps  involved  in  a statist! 
cal  test  [Ref.  4] : 

(1)  A test  statistic  is  calculated  from  the  observed 
data. 


53 


(2)  The  probability  of  obtaining  the  calculated  test 
statistic  is  determined. 

(3)  Assessment  is  made  of  the  adequacy  of  the  assumed 
distribution. 

(a)  If  the  probability  of  obtaining  the  calculated 
test  statistic  is  "low",  one  can  conclude  that 
the  assumed  distribution  does  not  provide  an 
adequate  representation. 

(b)  If  the  probability  of  obtaining  the  calculated 
test  statistic  is  not  "low",  then  the  data 
provide  no  evidence  that  the  assumed  distri- 
bution is  not  adequate. 

The  definition  of  "low"  or  "nor  low"  depends  on  the 
user's  preferences  and  the  consequences  of  rejecting  the 


distribution.  Since  a probability  of  0.1  or  0.05  or  less 
is  usually  said  to  be  low,  the  probability  of  0.05  was 
selected  as  the  reject  criterion. 


35 


, ~ VdD;.Iw 


The  above  steps  differ  slightly  from  the  more  usual 
procedure  in  which  the  test  statistic  is  compared  to  a 
value  which  is  such  that  the  area  under  the  distribution  to 
its  right  is  equal  to  the  selected  level  of  significance 
(i.e. , the  reject  criterion  is  the  value  of  the  variable 
such  that  the  probability  of  not  exceeding  this  value  is 
equal  to  one  minus  the  level  of  significance).  If  the  test 
statistic  is  greater  than  this  value,  the  assumption  can 
be  rejected  at  the  given  level  of  significance  [Ref.  13] . 

It  should  be  pointed  out  that  s.  statistical  test, 
although  it  allows  one  to  reject  an  assumption  as  inadequate, 
does  not  allow  one  to  prove  that  the  assumption  or  the  dis- 
tribution is  correct. 

In  this  study,  the  parameters  of  the  distribution 
for  corrective  maintenance  repair  times  are  not  known  and 
had  to  be  estimated  from  the  data.  The  two  statistical 
tests  suggested  by  Hahn  and  Shapiro  IRef.  4]  were  used. 

The  first  one  is  the  conventional  chi-squared  goodness-of- 
fit  test  [Ref.  14],  and  the  second  one  is  a test  developed 
by  Shapiro  and  Wilk  [Ref.  5],  called  the  W-test. 

The  use  of  the  W-test  to  evaluate  the  assumption  of 
a lognormal  distribution  was  done  (manually)  for  those  sets 
of  data  in  which  the  number  of  data  points  was  not  more 
than  50  (due  to  unavailability  of  tables  for  samples  of  size 
greater  than  50). 

3.  The  Chi-Squared  Goodness-of-Fit  Test 

This  test  is  one  of  the  oldest  and  most  commonly 
used  for  evaluating  distributional  assumptions.  Basically, 
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the  given  data  are  grouped  into  frequency  cells  and  com- 
pared to  the  expected  number  of  observations  based  on  the 
assumed  distribution.  The  test  statistic,  calculated  from 
this  comparison,  will  tend  to  exceed  a chi-square  variate 
if  the  assumed  distribution  is  not  correct. 

The  advantage  of  this  test  is  that  it  can  be  applied 
to  test  any  distributional  assumption  without  having  to  know 
the  values  of  the  distribution  parameters.  These  have  to 
be  estimated  as  part  of  the  test  procedure.  Its  disadvan- 
tages are  its  lack  of  sensitivity  in  detecting  inadequate 
assumptions  when  the  number  of  observations  is  small,  and 
the  need  to  arrange  the  data  into  arbitrary  number  of  cells 
( "equiprobable  cells"),  which  determines  the  number  of  de- 
grees of  freedom  and  can  affect  the  result  of  the  test. 

There  are  two  methods  for  dividing  the  data  into 
classes  or  cells:  one  is  applicable  when  the  data  are 
originally  arranged  in  frequency  classes  and  thus,  there  is 
no  need  to  determine  the  number  of  cells  since  the  original 
number  of  frequency  classes  is  used.  The  other  method, 
used  in  this  study  and  described  below,  applied  when  the 
data  are  not  initially  tabulated  in  classes.  In  this  case, 
the  number  of  cells  is  arbitrary.  Since  the  number  of  ob- 
servations in  the  samples  used  is  small  (less  than  200),  the 
rule  suggested  by  Hahn  and  Shapiro  [Ref.  4] , to  use  a number 
of  cells  as  large  as  possible,  subject  to  the  restriction 
that  it  must  not  exceed  n/5,  (n  - the  sample  size),  the 
number  of  cells  used  in  this  study  is  an  integer  less  than 
or  equal  to  n/5. 


The  computations  involved  in  the  chi-squared  good- 
ness-of-fit  test  were  made  by  a computer  program,  in  which 
were  given,  as  inputs,  the  assumed  cumulative  distribution 
function,  the  number  of  observations,  the  number  of  equipro- 
bable  cells  and  the  number  of  parameters  estimated  from  the 
sample.  The  outputs  were  the  chi-square  statistic  and  its 
probability  of  exceeding  a chi-square  variate  for  a given 
number  of  degrees  of  freedom. 

In  order  to  present  the  basic  calculations  involved 
in  the  test,  the  procedure  used  is  described  as  follows 
CRef . 4]  : 

(a)  The  cells  boundaries  are  determined  from  the  assumed 
cumulative  distribution  as  the  values  such  that  the 
probability  of  the  observation  value  falling  within 
a given  class  is  1/k  for  each  class: 

Pr.fx  1 xi]  = £ (U) 

where  x - the  random  observation  to  be  assigned  to  the 
i-th  cell 

x^  - tne  i-th  cell  boundary  to  be  solved  from  (11) 
k - the  number  of  cells,  in  this  case  equal  to  n/5 


The  lower  bound  of  the  first  cell  and  the  upper 
bound  of  the  last  cell  are  the  smallest  and  largest  values 
that  the  observations  (the  repair  time)  may  take  on. 

(b)  The  expected  number  of  observations  for  each  cell 
is  equal  to  n/k  (=  five  in  this  case)  for  each 
cell. 
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(c)  The  number  of  observed  values  in  each  cell,  M^,  is 
counted  ba.sed  on  the  results  of  equation  (11). 

(d)  The  test  statistic  is 


2 

Ce)  The  computed  value  X is  used  to  compute  the  level 

of  significance,  or  the  probability  of  a chi-square 

variate  with  v degrees  of  freedom  (equal  to  k-m-1, 

where  m is  the  number  of  parameters  estimated  from 

2 

the  sample)  to  exceed  the  calculated  X : 

a = Vxl-a(v)  1 x2l  (13) 

If  a is  less  than  or  equal  to  0.05  the  assumed 
distribution  can  be  rejected  as  inadequate. 

4.  The  W Test  to  Evaluate  the  Assumption 
of  a Lognormal  Distribution 

The  W test  is  shown  in  Reference  5 to  be  an  effec- 
tive procedure  for  evaluating  the  assumption  of  normality 
against  non-normal  alternatives,  even  if  only  a relatively 
small  number  of  observations  are  available.  Hahn  and  Shapiro 
IRef.  4J  suggest  that  the  W test  may  also  be  used  to  evaluate 
the  assumptions  of  a lognorrial  distribution.  This  follows 
because  if  the  logarithms  of  the  observations  follow  a nor- 
mal distribution,  then  the  original  values  of  the  observa- 
tions are  lognormally  distributed. 


The  following  is  the  procedure  applied  while  using 
tables  from  Reference  4 and  which  are  reproduced  and  given 


in  Appendix  C. 

(a)  The  observations  are  ordered  such  that  £ x2  <_ 
— 1 xn- 

(b)  The  following  parameters  (for  the  lognormal  assump- 
tion) are  computed 

(i)  r 20 

n 


S2  . £ (in  Xl)2  - 
i=l 


r20  “i 

E W 

Li=l  J 


(14) 


(ii)  If  n is  even,  k - n/2;  if  n is  odd,  k = (n-l)/2. 
Then, 

k 

b * E lan-l+l(ln  Vi+1  - ln  V (15> 

i=l 

where  the  values  of  a . for  i=l,...,k  are 

n-i+1 

given  in  Table  VII  (Appendix  C),  for  3 £ n <_ 
50. 

(iii)  The  test  statistic,  W,  is 


a 


I 


« 


w = 


(16) 


(c)  The  approximate  probability  of  obtaining  the  calcu- 
lated value  of  W can  be  obtained  from  Table  VIII 
(Appendix  C)  or  from: 


, . . W-e 

z = X + x]  ln[y-^] 


(17) 
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using  the  values  of  X.  r)  and  e given  in  Table  IX 
(Appendix  C)  for  the  appropriate  sample  size,  and 
then  using  the  standardized  normal  distribution  to 
determine  the  probability  of  obtaining  a value  less 
than  or  equal  to  z,  which  is  the  significance  level 
of  the  test: 


a = P [Z  _<  z] 


(18) 


If  a is  less  than  or  equal  to  0.05,  the  selected 
level  of  significance  in  this  study,  the  lognormal 
distribution  can  be  rejected  as  an  inadequate 
assumption. 

Hahn  and  Shapiro  IRef.  4]  also  suggest  the  use  of 
a test  for  the  assumption  of  an  exponential  distribution, 
called  the  WE  test.  In  this  test,  used  in  some  cases  in 


this  study,  the  WE  statistic  calculated  from  the  data  is 


I } 


compared  against  a 90%  or  95%  range  (equal  to  a significance 
level  of  0.1  or  0.05  respectively),  which  is  defined  by  a 
lower  and  an  upper  point.  If  the  WE  statistic  falls  outside 
this  range,  i.e.  a too-high  or  too-low  value,  it  indicates 
non-exponentiality . A detailed  description  of  the  test  pro- 
cedure is  given  in  Reference  4. 


C.  THE  ANALYSIS  PROCESS 

The  methods  and  techniques  described  were  used  primarily 
in  order  to  analyze  each  set  of  data  for  the  assumption  for 
the  lognormal  distribution.  The  exponential  distribution 
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assumptions  was  also  tested. 

Basically,  the  process  for  the  analysis  for  each  set  of 
data  has  been  the  following: 

(1)  Review  of  the  data  and  preparation  for  computer  run 

(keypunching) . 

(2)  Computer  run,  which  includes  the  following  functions: 

(a)  Sorting  the  data  in  ascending  order. 

(b)  Computation  of  the  "approximate  cumulative 

frequency”  (or  the  expected  value  of  the  ordered 

i-0  5 

observations),  using  — jp—  x 100  for  the  i-th 
observation,  where  n is  the  sample  size  (see 
Appendix  B). 

(c)  Printout  of  a table  of  the  data  (repair  times) 
and  their  plotting  position  points  in  ascending 
order,  for  plotting  purposes. 

(d)  Calculation  and  plotting  of  the  theoretical  and 
sample  CDF,  based  on  the  exponential  and  lognor- 
mal distributions.  (This  is  done  by  a routine 
from  the  IMSL  package.) 

(e)  Chi-squared  goodness-of-f it  test  for  the  assump- 
tions for  the  exponential  and  lognormal  distri- 
butions, using  a routine  from  the  IMSL  package 
which  gives  the  value  of  the  test  statistic  and 
the  probability  of  obtaining  it  for  a given  dis- 
tribution. 

(f)  Calculation  of  the  sample  mean  and  variance,  the 
lognormal  distribution  parameters  and  the  median, 
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90th  and  95th  percentiles  based  on  both  the 
exponential  and  the  lognormal  distributions 
parameters. 

(g)  Calculation  of  the  percentage  error  between  the 
results  of  the  mean  and  percentiles  of  the 
exponential  distribution  relative  to  those  of 
the  lognormal  distribution. 

(h)  Printout  of  the  above  results  in  a summary 
table. 

(3)  Based  on  the  plotting  positions  (item  c above),  each 
set  was  plotted  on  lognormal  probability  paper.  A 
line,  which  represents  the  "best"  fit  to  the  data 
points  was  drawn . 

(4)  Estimated  parameters  and  percentiles  from  the  plot 
were  determined.  The  percentage  errors  between  the 
results  from  the  plot  and  those  from  the  theoretical 
lognormal  calculation  were  calculated. 

(5)  A W-test  was  performed  for  the  lognormal  distribu- 
tion assumption,  for  those  sets  which  have  up  to  50 
data  points. 

(6)  An  analysis  of  the  results,  based  on  both  the  sta- 
tistical tests  and  the  probability  plot  was  performed. 

(7)  As  a result  of  the  analysis,  the  need  for  further 
statistical  tests,  such  as  testing  for  normality  or 
a WE-test  for  exponentiality  [Ref.  4],  was  deter- 
mined. Also  when  needed,  a probability  plot  on 


43 


2 

■ag  ggg  - 


chi-square  (two  degrees  of  freedom)  probability 
paper  was  made  and  in  some  cases  a histogram  was 


drawn,  in  order  to  get  insight  to  the  shape  of  the 
sample  distribution. 
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IV. 


DATA  SOURCES  DESCRIPTION 


A.  GENERAL 

All  of  the  repair  times  used  in  the  analysis  come  from 
maintainability  demonstration  reports  for  electronic  sys- 
tems/equipment. In  most  of  the  cases,  these  reports  include 
a description  of  the  tests  used  during  the  maintainability 
demonstration.  These  details  have  been  examined  in  order  to 
analyze  specific  repair  times  that  vary,  to  some  extent, 
from  the  expected  value. 

All  the  data  sources  include  the  various  elements  of 
repair  time  such  as  diagnostic  (localization  and  isolation), 
removal/replacement,  verification  and  check-out  time.’  The 
time  elements  are  combined  in  the  reports  differently,  de- 
pending on  the  nature  of  the  demonstration  test  and  the 
equipment . 

Although  one  of  the  objectives  of  this  study  was  to  test 
the  lognormal  distribution  for  corrective  maintenance  re- 
pair time  of  mechanical  systems/ equipments , repair  time 
data  for  such  systems  were  not  obtainable. 

The  systems /equipments  analyzed  are  listed  in  Table  I, 
which  includes  the  source  references. 

The  following  is  a discussion  of  the  data  source  reports 
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B.  DISCUSSION  OF  SOURCE  REPORTS 


(1)  RADC  Case  Histories  in  R & M Demonstrations 
[Ref.  15] 


This  paper  provides  tables  of  repair  times  for 


six  electronic  systems.  The  purpose  of  the  paper  was  to 


discuss  case  histories  of  reliability  demonstration  and 


of  maintainability  demonstration.  The  maintainability  de- 


monstrations generally  supported  the  assumption  of  the 


lognormal  distribution  of  repair  times.  However,  devia- 


tions were  observed  in  some  cases,  in  both  the  paper  and 


in  this  study. 


The  only  method  used  in  the  paper  for  the  purpose 


of  "statistical  analysis",  which  was  not  the  purpose  of 


the  paper,  was  the  use  of  histograms  of  the  number  of  re- 


pair actions  versus  the  time  required  to  finish  a repair 


action.  A histogram  alone,  even  though  it  may  provide  some 


ideas  about  the  overall  shape  of  the  data  d.i  stribution,  is 


not  an  accurate  technique  to  assess  whether  a particular 


distribution  fits  the  data  or  not. 


The  criterion  for  success  or  failure  of  maintainability 


demonstration,  in  most  of  the  cases,  depend  on  whether  the 


demonstrated  mean  time  is  or  is  not  less  than  the  required 


mean  time  to  repair.  This  criterion,  satisfactory  for  some 


purposes,  is  not  what  was  used  in  this  study  to  determine 


whether  a set  of  data  follows  the  pattern  of  a lognormal 


distribution  or  not.  Fortunately  the  authors  of  the  paper 


provided  tables  of  maintenance  actions  times  for  each  case, 


,for  anyone  who  wishes  to  perform  a more  detailed 


statistical  analysis". 


(2)  R/M  Assessment  and  Demonstration  Test  Report 

on  AN/ARC-164(V)  Radio  Set  [Ref.  16] 

This  report  includes,  in  detail,  the  maintainabil- 
ity demonstration  test  data  sheets  for  organizational  and 
intermediate  levels.  The  system  consists  of  four  Line- 
Replaceable  Units  (LRU’s).  The  number  of  maintenance  tasks 
was  in  accordance  with  Appendix  A of  MIL-STD-471  (Replaced 
by  I.1IL-STD-471A-Ref . 3). 

The  purpose  of  the  maintainability  demonstration 
test,  as  stated  in  the  report,  was  "to  demonstrate  compli- 
ance to  the  quantitative  maintainability  requirements  speci- 
fied (for  the  system)".  Method  2 of  MIL-STD-471  (which  is 
now  method  9 of  MIL-STD-471A  Ref.  3),  was  used  to  determine 
the  accept/reject  criteria. 

In  this  study  only  the  50  repair  actions  for  inter- 
mediate level  were  tested  and  analyzed. 

(3)  AN~/ASN-131(SPN/GEAHS)  - Maintainability  Assessment 

and  Demonstration  on  Final  Report  [Ref.  17] 

The  objective  of  the  maintainability  demonstration 
was  to  evaluate  the  maintainability  characteristics  of  the 
AN/ASN-131  Inertial  Measurement  Unit  (IMU)  and  Interface 
Electronics  U.-it  (IEU). 

Twenty-two  organizational  level  maintenance  func- 
tions and  22  intermediate  level  functions  were  demonstrated. 
The  tests  were  intended  to  demonstrate  the  effectiveness  of 
Built-In-Test-Equipment  (BITE)  for  fault  isolation  to  the 
LRU  level  for  organizational  maintenance  and  for  the  printed 
circuit  board  or  module  level  for  intermediate  level 
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maintenance,  which  consisted  of  isolated  and  repairing 
faults  on  printed  circuit  boards  or  modules  in  all  major 
assemblies. 

Worksheets  containing  all  raw  data  were  included 
in  the  report.  This  enabled  the  analysis  of  extreme 
points  in  this  study.  In  order  to  utilize  the  data,  four 
separate  sets  were  prepared,  one  for  each  of  the  mainte- 
nance levels  for  IMU  and  for  IEU.  Since  each  of  these 
sets  contained  a relatively  small  number  of  elements,  the 
organizational  level  and  the  intermediate  level  repair 
times  for  both  of  the  units  (IMU  and  IEU),  were  combined 
(i.e.,  the  analysis  was  performed  on  each  of  the  mainte- 
nance levels  rather  than  on  the  subsystems).  It  is  mean- 
ingless to  use  all  the  42  times  available  (in  one  task  on 
the  IMU,  the  repair  times  were  not  available)  together  be- 
cause of  basic  differences  in  repair  actions  and  times 
between  organizational  level  and  intermediate  level. 

The  report  does  not  include  any  assessment  of  the 
distribution  of  repair  time.  The  demonstration  was  per- 
formed in  accordance  with  MIL-STD-471,  Test  Method  3 (which 
is  equivalent  to  test  method  4 in  MIL-STD-471A  - Ref.  3). 


(4)  Final  Report  - Maintainability  Demonstration 
for  Harpoon  5CLCS  [Ref  IS] 


The  maintainability  demonstration  report  for  the 
Harpoon  Ship  Command-Launch  Control  Set  (HSCLCS)  includes 
a statistical  analysis  of  corrective  maintenance  repair 
times  and  detailed  technical  discussion  which  made  it  pos- 
sible to  filter  the  data  in  order  to  remove  anomalies  which 
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biased  the  data.  For  example,  all  the  switchboard  times 
or  tasks  in  which  the  repair  time  was  estimated  were 
eliminated.  This  is  because  the  switchboard  was  not  part 
of  the  equipment  demonstrated,  but  it  failed  during  the 
demonstration  and  its  repair  times  were  included  in  the 
report. 

In  the  data  analysis  part  of  the  report,  there  are 
indications  of  the  suitability  of  the  lognormal  distribu- 
tion to  corrective  maintenance  repair  times.  This  is 
assessed  from  histograms  and  a chi-squared  test,  which  is 
not  presented  in  the  report.  These  assessments  were  made 
in  order  to  determine  the  maximum  expected  repair  time. 

It  is  also  pointed  out  that  the  "remove/replace"  time  is 
the  outstanding  element. 

The  statistical  analysis  was  performed  in  accord- 
ance with  MIL-STD-471,  Test  Method  2 (MIL-STD-471A,  Test 
Method  9) . 

It  is  said  in  the  report  that  "The  statistical 
tests  on  the  mean  and  maximum  repair  times  indicate  that 
the  system  meet  the  specified  requirements  even  when  the 
switchboard  times  are  included"  and  .... "Histograms  of  the 
time  data  and  their  logarithms  show  clearly  the  superiority 
of  the  fit  of  the  "lognormal"  form  over  the  "normal”  form. 

No  sophisticated  statistical  tests  are  really  necessary  in 
deriving  the  recommendation/decision  to  use  the  "lognormal" 
form. " 

Despite  the  above  statements,  the  analysis  performed 
in  this  study  shows  different  results,  concerning  the  fit 


of  the  lognormal  distribution  to  the  repair  times  (see 
Table  III  in  Section  V). 


(5)  DSIS-SCF  Maintainability  Demonstration  Report 
[Ref.  19] 


This  report  presents  a summary  of  the  maintainabil- 
ity demonstration  of  the  Defense  Communication  System/ 
Satellite  Control  Facility  Interface  System  (DSIS)  for  the 
Satellite  Control  Facility  (SCF).  The  demonstration  con- 
sisted of  50  test  faults,  (25  for  on-line  repair  and  25  for 
off-line  repair).  A delay  time  of  two  minutes  to  simulate 
getting  the  spare  part  was  charged  against  the  overall  re- 
store time  for  each  LRU  that  was  removed  and  replaced  as 
part  of  the  fault  isolation  procedure. 

The  specific  Failure  Data  Sheets  used  for  each 
test  are  included  in  the  report.  This  allowed  verification 
of  some  data,  which  were  originally  rounded-off. 

The  analytical  techniques  presented  in  MIL-STD-471, 
Test  Method  2 (MIL-STD-471A,  Test  Method  9),  were  used  to 
determine  MTTR. 

No  assessment  or  consideration  has  been  made  in 
the  report  on  the  distribution  of  the  repair  times. 

The  on-line  repair  times  and  the  off-line  repair 
times  were  used  separately  for  the  statistical  analysis  in 
this  study,  since  it  is  meaningless  to  combine  them. 


(6 ) Philco-Ford  Corp. , Western  Development  Laborato- 
ries/Ford Aerospace  and  Communications  Corp.  ESP 
- Maintainability  Demonstration  Reports 
[Refs.  20-28] 


A number  of  partial  reports  of  maintainability 
demonstration,  primarily  on  communication  systems  and 
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subsystems,  have  been  used  as  a source  for  maintenance  ac- 
tion time  data.  The  demonstrations  reported  in  these  re- 
ports were  conducted  between  1972  and  1978. 

There  are  some  characteristics  which  appear  in 
almost  all  these  reports: 

(a)  The  maintenance  actions  were  to  the  LRU  level. 

(b)  The  number  of  tests,  50  in  most  of  the  cases,  is 
based  on  MIL-STD-471,  Test  Method  2. 

(c)  The  data  analysis  tends  to  show  that  the  distri- 


bution of  corrective  maintenance  repair  time  is 
essentially  lognormal.  This  has  been  shown  by 
using  a plot  on  lognormal  probability  paper. 

(This  alone  is  not  sufficient,  as  is  shown  in  this 
study.)  A straight  line  through  the  plotted  data 
was  drawn  by  using  the  calculated  values  of  the 
50th  and  90th  percentiles,  which  does  not  take 
into  consideration  expected  variations  at  the  ex- 
treme points. 

(d)  In  three  cases  there  is  an  analysis  of  "achieved" 
versus  "inherent"  maintenance  times.  The  reasons 
for  the  difference  in  the  maintenance  times  are 
related  to  supply  and  to  availability  of  proper 
Aerospace  Ground  Equipment  (AGE).  In  some  cases 
the  difference  was  due  to  lack  of  familiarity  with 
the  equipment  and  the  technical  documentation. 

In  general,  the  conclusions  on  the  underlying  dis- 
tribution of  corrective  maintenance  repair  times,  were  the 
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same  as  those  reached  in  this  study,  except  for  a few  cases, 
discussed  later,  in  which  there  are  opposite  conclusions, 
with  regard  to  the  exponential  and  lognormal  distributions. 

Basically,  an  error  was  made  when  plotting  the 
data  on  exponential  graph  paper,  from  which  is  was  concluded 
that  the  exponential  distribution  is  a good  fit.  In  one 
such  case  [Ref.  23]  an  "explanation"  is  given:  "....Figure  1 
(a  semi-logarithmic  graph  paper)  shows  that  the  data  is 
exponentially  distributed,  which  frequently  occurs  when 
repair  techniques  include  diagnostics  which  have  clustered 
running  time  and  component  replacement  times  which  are 
constant."  The  results  of  this  study  do  not  support  this 
statement  as  discussed  in  Section  VA2. 

In  most  of  the  cases,  the  deviations  of  the  data 
points  from  a straight  line  on  lognormal  probability  paper 
included  in  the  reports  are  not  significant.  However,  in 
two  cases  [Refs.  20  and  26] , the  deviations  cannot  be  con- 
sidered random.  The  explanation  given  in  Reference  26  may 
explain  many  of  the  deviations  in  this  and  other  cases :- 

" the  constant  low  maintenance  time  distribution  at  the 

lower  end  of  the  graph  is  caused  by  the  low  time  fault 
isolation  and  "patching"  of  redundant  up  and  down  converters." 


V.  DATA  ANALYSIS  RESULTS 


A.  RESULTS  OF  TESTS  FOR  DISTRIBUTIONAL  ASSUMPTIONS 
1.  Summary  of  Results 

Table  II  summarizes  the  results  of  the  statistical 
test  analysis.  It  shows  for  each  case  the  probability  of 
getting  the  calculated  test  statistic,  which  is  the  level 
of  significance  of  the  test  to  be  compared  to  the  five 
percent  level  chosen  as  the  reject  criterion. 

In  those  cases  in  which  the  results  of  the  chi- 
squared  test  and  the  W test  contradict  each  other,  a 
plot  on  lognormal  probability  graph  paper  was  used  to 
determine  the  appropriateness  of  this  assumption  ((+)  in 
Table  II). 

Most  of  the  sets  of  data  show  that  the  lognormal 
distribution  cannot  be  rejected  as  an  adequate  descriptor 
for  corrective  maintenance  repair  time.  From  Table  II, 
the  assumption  of  the  exponential  distribution  is  rejected 
in  17  sets,  while  in  four  more  sets  (sets  3,  14a,  14b  and 
18a)  the  probability  of  getting  the  chi-square  test  sta- 
tistic is  less  than  0.1.  The  assumption  of  the  lognormal 
distribution  cannot  be  rejected  in  16  sets,  while  in  four 
sets  (sets  10a,  13b,  14a  and  18a),  discussed  later,  the 
results  of  the  two  tests  indicate  opposite  conclusions  with 
regard  to  rejection  of  the  lognormal  assumption.  In  three 
sets  (sets  5,  9 and  11)  both  assumptions  are  rejected  and 
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TABLE  II 


Probability  of  Getting  Test  Statistics 


Set  Sa 
No.  S 


Exponential 


0.04 

0.006 

0.06 

0.15 

m-24 


0.005 

0.04 

io-3 

0.006 

0.11 

,«-7 


0.002 

IO'8 

0.096 

0.063 

0.014 

10'4 

0.395 

0.086 

0.05 

0.03 


0.23 

0.27 

0.94 

0.92 

IO'9 

0.32 

0.13 

0.094 

0.71 


Lognormal 
P[W] 


0.06 


0.71 


0.07 

0.06 

0.25 

0.87 


0.053  < 0.01 


0.11 

0.11 


0.05 

0.42 


0.004  < 0.01 


0.41 

0.15 

0.016 

0.45 

0.35 

0.17 

0.34 

0.006 

0.047 

0.15 

0.36 


0.06 
0.58 
0.07 
0.03 
0.26 
0.85 
0.43 
< 0.01 
0.85 
0.86 
0.98 


7T*)I 


Criterion  for  reject  if  P[x“]  or  P I W3  £ 0.05. 

To  be  determined  from  probability  plot/histograra. 


and  in  four  sets  (sets  3,  4,  10b  and  14b)  both  assumptions 
cannot  be  rejected;  however  the  resulting  probabilities 
for  the  lognormal  distribution  are  much  higher.  Only  in 
one  set  (set  17)  is  the  lognormal  distribution  rejected 
and  the  exponential  distribution  cannot  be  rejected.  The 
sets  in  which  the  lognormal  distribution  is  rejected  are 
sets  5,  9,  11  and  17. 

The  detailed  results  of  the  data  analysis  and  the 
probability  plots  for  each  set  are  presented  in  Appendix  D. 

The  following  is  an  example  of  the  computer  program 

o 

summary  table  which  includes  the  results  for  the  x good- 
ness-of-fit  test  and  calculated  parameters  from  the  sample 
data. 


AN/GSA-51 

BAC 

K ’J°  INTERCE 

PT9R  CONTROL 

SYSTEM 

SAMPLE  SIZE 

N = 

90  NO. 

OF  CELLS  K 

= 18 

(a) 

SAMPLE  MEAN  = 

20 

.43  STANDARD  DEV  = 

17.07 

(b) 

EXPONENTIAL 

LQGN0RMAL 

ERROR 

PA^&mi 

0.05 

2.73 

(c) 

PAR  AM2 

0.57 

M7TR 

20.  43 

20.42 

0.06 

% 

50-th  PcRCN” 

14.  16 

15.33 

7.64 

% 

(d) 

9C-TH  PERCNT 

47.  04 

40.46 

16.28 

% 

9 5-TH  0 ER  CNT 

61.21 

52.25 

14.94 

% 

CHI-SQR  STAT 

25.60 

7.60 

(e) 

DEG  OF  FREED 

16 

15 

(f) 

SIGN  IF  LEVEL 

0.599E-01 

0.S39E  00 

(g) 

Notes: 

(a)-  The  number  of  equiprobable  cells,  K,  was  chosen  as 
N 

— where  N is  the  sample  size. 
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(b) -  The  sample  mean  and  the  sample  standard  deviation 

are  calculated  based  on  the  maximum  likelihood 
estimates. 

(c) -  PAR AMI  for  the  EXPONENTIAL  distribution  is  the  re- 

ciprocal of  the  sample  mean.  For  the  LOGNORMAL 

2 

distribution  PARAM1  and  PARAM2  are  u and  a , the 
parameters  of  the  lognormal  distribution  (equations 
(5)  and  (6)  in  Section  IIA). 

(d) -  The  MTTR  and  the  50th,  90th  and  95th  percentiles 

are  calculated  from  the  sample  and  are  based  on  the 
relationships  between  the  calculated  parameters  and 
their  distribution  functions  (equations  (7)  and  (10) 
in  Section  IIIA).  The  percentage  error  is  between 
the  exponential  and  lognormal  MTTR  and  percentiles 
(equation  (25)  in  Section  VB). 

(e) -  The  chi-square  statistic  is  calculated  from  equation 

(12)  - Section  IIIB3. 

(f) -  The  number  of  degrees  of  freedom  is  K-2  for  the 

exponential  distribution  assumption  and  K-3  for  the 
lognormal.  This  is  because  one  parameter  is  esti- 
mated from  the  sample  in  the  exponential  case  and 
two  in  the  lognormal  case. 

(g) -  The  level  of  significance  is  the  probability  of  a 

o 

X variate  with  the  specified  degrees  of  freedom 
exceeding  the  calculated  chi-square  statistic. 

The  complete  data,  chi-square  computation,  and  re- 
sults of  the  above  example  are  given  in  Appendix  E. 
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2.  Discussion  of  Results 


The  following  discussion  refers  to  those  cases 
which  either  do  not  satisfy  the  underlying  assumption 
or  are  of  special  interest  as  their  results  are  differ- 
ent from  the  others  and/or  point  out  some  interesting 
issues. 

(a)  Set  No^  4 - AN/FPSZ80 

This  case  was  presented  as  an  unsuccessful  one 
in  the  source  paper  [Ref.  15]  due  to  inexperienced  techni- 
cians and  the  need  for  adjustment  factors  to  the  repair 
times  during  the  demonstration.  That  conclusion  is  based 
on  the  histogram  which  is  presented  in  the  paper  which  can- 
not be  used  to  test  a distributional  assumption.  Indeed, 
the  results  of  the  statistical  tests  and  the  plot  on  lognor- 
mal probability  show  that  the  lognormal  distribution  cannot 
be  rejected  with  a high  level  of  significance  (0.92).  The 
result  of  the  chi-squared  test  for  the  exponential  distri- 
bution shows  that,  had  it  been  tested  separately,  one  would 
fail  to  reject  it  with  a level  of  significance  of  0.15. 

Thus,  one  would  tend  to  accept  the  lognormal  distribution 
in  this  case  due  to  the  high  level  of  significance  as  com- 
pared to  the  exponential.  Therefore,  in  cases  like  this 
one,  careful  analysis  must  be  made  and  more  than  a single 
test  should  be  performed  in  order  to  determine  the  suit- 
ability of  a distribution. 

(b)  Set  No_j_  5 z AN/TPSZ39(V) 

This  case  was  presented  as  a definite  violation 
of  the  lognormal  distribution  characteristics.  The  reasons, 
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as  given  in  the  paper  [Ref.  15],  are  attributed  to  the 
size  of  the  equipment.  It  is  suggested  there  that  the 
normal  distribution  should  be  considered  as  an  adequate 
descriptor  because  the  repair  times  for  small  equipment 
are  short  and  have  small  variations  around  a mean  value. 

A histogram  in  the  paper  indicates  "almost"  a normal 
distribution.  However,  a chi-squared  goodness-of-f it  test 
for  normality  rejects  this  assumption  at  a 0.005  level  of 
significance.  The  exponential  and  lognormal  distribution 
assumptions  are  also  rejected.  One  reason  for  this  might 
be  that  the  repair  times  are  rounded-off  to  the  nearest 
minute,  and  as  a result  there  are  clustered  data  points 
which  do  not  follow  any  particular  distribution.  The  log- 
normal probability  plot  (Figure  6)  shows  these  clustered 
data  points  to  which  a straight  line  cannot  be  fitted. 

Other  reasons  behind  this  phenomenon,  in  this  and  other 
cases,  require  a separate  analysis. 

(c)  Set  No^  6 - AM/_3949-GR_ 

In  this  case,  the  histogram  including  all  57 
repair  times  was  bi-raodal  [Ref.  15]  and,  therefore,  does 
not  fit  either  distribution  assumption.  However,  one  third 
of  the  repair  times  were  for  a single  fault,  replacement  of 
the  transmitting  tube.  Filtering  out  these  19  data  points 
resulted  in  a histogram  in  the  paper  which  appears  lognormal. 
Indeed,  the  statistical  tests  show  this  to  be  a valid 
assumption. 
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(d)  Set  No^  10_-_DSIS-SCF 

In  this  case,  50  tests  were  conducted  during 
the  maintainability  demonstration,  25  for  on-line  repair 
and  25  for  off-line  repair.  The  equipment  has  much  re- 
dundancy which  allows  on-line  repair  by  "reconfiguring" 
the  system  by  patching  [Ref.  19]. 

For  the  on-line  repair  times  (set  10a),  the 
chi-squared  test  rejects  the  assumption  for  the  exponen- 
tial distribution  but  not  for  the  lognormal.  For  the  off- 
line repair  times  (set  10b),  the  chi-squared  test  resulted 
in  the  same  probability  for  both  assumptions  and,  in  fact, 
neither  assumption  is  rejected.  A WE  test  for  exponen- 
tiality  and  a W-test  for  lognormality  resulted  in  "accept- 
ance" of  both  distributions.  A histogram  of  five  minute 
intervals  (Figure  7)  indicates  a roughly  lognormal  distri- 
bution which,  together  with  the  higher  probability  of 
getting  the  W test  statistic  and  the  lognormal  probability 
plot  (Figure  8),  show  that  the  lognormal  distribution  is 
still  a "better"  descriptor,  and  that  off-line  repair  times 
are  better  described  by  a lognormal  distribution  than  on- 
line repair  times  are. 

(e)  Sets__No .__13,_14  and  18__-__User  Display  Segments_ 

The  demonstration  reports  for  these  cases 

[Refs.  22,  23  and  27],  include  separate  repair  times  - 
"inherent"  and  "achieved".  The  "achieved"  repair  time  in- 
cludes additional  time  required  for  obtaining  test  equipment, 
tools,  spare  items  and  maintainability  information  during 
the  demonstration  tests. 
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The  validity  of  the  lognormal  distribution, 
when  differentiating  between  "inherent"  (sets  13a,  14a  and 
18a)  repair  time  and  "achieved"  (sets  13b,  14b  and  18b) 
repair  time  is  not  quite  obvious. 

The  following  results  for  the  lognormal  dis- 
tribution assumption  were  obtained  for  each  one  of  the 
six  sets: 


Case/Set 


Test : 


13 

14 
18 


Inherent ( a) 

xl  JL  plQt 

N/R  N/R  G 

N/R  R P 

R N/R  G 


Achieved(b) 

xf  W Plot 

R N/R  P 

N/R  N/R  G 

N/R  N/R  G 


where 

N/R  - Not-Rejected;  R- Rejected;  G-Good  Fit;  P - Poor  Fit. 

For  "inherent"  repair  time  the  lognormal  dis- 
tribution assumption  is  not  rejected  by  both  tests  in  Case 


13,  but  it  is  rejected  by  the  W test  in  Case  14  and  by  the 


X test  in  Case  18.  For  "achieved"  repair  time,  this  as- 

.2 


sumption  is  rejected  by  the  x test  in  Case  13,  but  it  is 
not  rejected  by  either  test  in  Case  14  and  Case  18.  The 
lognormal  probability  plots  (Appendix  D)  show  poor  fit  in 
sets  13b  and  14a.  Since  in  these  three  cases  the  statistical 
tests  indicate  different  results,  no  assessment  can  be  made 
of  the  lognormal  distribution  assumption  for  "inherent"  or 
"achieved"  repair  time.  However,  in  sets  13a,  14b  and  18b 
this  assumption  cannot  be  rejected.  We  were  unable  to 
account  for  these  anomalies  since  no  consistent  pattern  is 
evident.  Further  investigations  and  discussion  with  the 
individuals  who  conducted  the  demonstration  tests  is 
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required  in  order  to  account  for  this. 


(f)  Sets_No ,_17  and  i9_-_HT/MT_ Terminal  and 

Autodin  Memory /Memory  Control_  Equipment, 

These  two  cases  are  discussed  because  their 
results  would  have  been  expected  in  the  opposite  way. 

While  the  analysis  results  indicate  that  the  first  case 
(Case  17)  violates  the  assumption  of  lognormality  and  that 
in  the  second  case  (Case  19)  the  lognormal  distribution  fits 
the  data,  the  assumptions  made  in  the  demonstration  reports 
[Refs.  26  and  28]  are  that  in  the  first  one  the  lognormal 
distribution  assumption  is  valid  and  in  the  second  the 
exponential  distribution  is  an  adequate  model. 

The  assumptions  in  the  reports  were  based  on 
the  nature  of  the  equipment,  rather  than  on  statistical 
tests.  Probability  plotting  used  in  these  reports  have 
been  found  to  be  inaccurately  interpreted  (Case  17)  and 
incorrect  (Case  19). 

In  Case  17,  the  lognormal  probability  plot  in- 
cluded in  the  report  does  not  show  a straight  line;  most  of 
the  deviations  are  at  the  lower  level  (Figure  9).  But, 
it  is  concluded  in  the  report  [Ref.  26]  that  the  lognormal 
distribution  fits  the  data.  Both  the  chi-squared  and  W 
tests  reject  this  assumption.  The  assumption  for  the  expo- 
nential distribution  appears  to  be  appropriate  in  this  case. 
This  is  indicated  by  the  chi-squared  test  for  exponential- 
ity,  the  exponential  probability  plot  (Figure  10),  and  a 
histogram  (Figure  11).  The  reasons  for  these  results  re- 
quire further  investigation  and  analysis. 
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Figure  9:  Lognormal  Probability  Plot  [HT/MT  Terminal] 
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In  Case  19,  a plot  of  the  data  on  logarithmic 
graph  paper  included  in  the  report  "shows"  a straight  line. 
However,  the  way  that  plot  was  made  is  incorrect  because 
the  cumulative  percentage  points  against  which  the  data 
points  were  plotted,  were  calculated  from  the  exponential 
distribution  function  using  the  sample  mean,  and  not  by 
calculating  the  expected  values  of  the  ordered  observations. 
This  is  why  the  plot  resulted  in  a straight  line  with  no 
deviations.  Multiple  points  are  not  taken  into  account 
when  the  plot  is  so  made.  Indeed  the  statistical  test  re- 
sults, the  lognormal  probability  plot  (Figure  12),  and  the 
exponential  probability  plot  (Figure  13)  show  that  the  ex- 
ponential distribution  assumption  should  be  rejected,  while 
the  assumption  of  lognormality  cannot  be  rejected. 

B.  ERRORS  IN  CALCULATED  AND  ESTIMATED  PARAMETERS 

1 . Error  in  MTTR  and  Inherent  Availability  when 

Assuming  an  Exponential  Distribution 

The  steady-state  form  of  inherent  availability, 
equation  (1),  is  easily  derived  from  calculus  using  assump- 
tions of  an  exponential  distribution  for  failure  and  repair 
times.  The  expression  for  availability  as  a function  of 
time  is  then 

, MTBF  , MTTR  lMTTR  MTBFJ  x 

i^'  MTBF+MTTR  MTBF+MTTR  e 1 ' 

The  steady-state  term,  the  first  term  in  the  above 
equation,  can  be  applied  without  making  any  assumptions  on 
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Figure  12:  Lognormal  Probability  Plot  [Autodin  Memory/ 
Memory  Control  Equipment] 
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igure  13:  Exponential  Probability  Plot  {Autodin  Memory/ 
Memory  Control  Equipment] 
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the  distributions.  However,  most  theoretical  papers  and 


many  applied  papers  are  written  using  exponential  distribu- 


tion . assumptions  for  both  failure  and  repair  times. 


Since  for  a high  availability  what  is  desired  is 


a high  MTBF  and  a low  MTTR,  equation  (1)  can  be  rewritten 


Ai  ~ , MTTR 
1 MTSf 


(20) 


In  a practical  case,  MTTR  is  of  the  order  of  one 


hour  or  less,  while  MTBF  is  of  the  order  of  100  to  1000 


hours.  Thus,  MTTR /MTBF  s 0.01  to  0.001. 


Furthermore,  the  expression  for  availability  (20) 


can  be  approximated  from  the  series  expansion  of 


4-=l-x+x2- 


+ (-1)1  x1 


(21) 


= 23  '-d1  x1 


Therefore,  when  x = 


MTTR 


MTBF 


, this  becomes 


1 

MTTR 


MTBF 


00 

= V (_!)*  rMTTS]1 
1 L)  [mtbfJ 


(22) 


The  approximation  form  is  given  by  the  first  two 


terms  of  the  expansion 


f-  "--xjtefe 

a! 


W'' 


I 


m 


B5 


1 I 


M. 


i- 
|!*  ; 


R~ 

I' 


m k 


<"  5 ■-■>  ' 7-.  v.  • •-,•?■■  : 


^rare-i  yvr»'  ^ v i 


1 >WEW?iV<W  ViWfSWS 


MTBF 
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~ 1 - 


MTTR 


MTBF 


(23) 


The  error  in  the  approximation  is  less  than  the 
third  term  of  the  expansion 


E < 


(24) 


Therefore,  an  error  of  few  percent  in  MTTR  by  assum- 
ing an  exponential  distribution,  instead  of  a lognormal 
distribution,  will  have  negligible  effect  on  availability, 
which  is  the  measure  of  interest  when  dealing  with  opera- 
tional readiness  or  system  effectiveness. 

The  percentage  error  in  the  mean-time-to-repair  is 
calculated  as  follows 


M 


E = 


LOG 


M 


x 100 


LOG 


(25) 


where 


M. 


LOG 


4 2 

the  lognormal  mean  = eu  * , where  y and  a‘ 

are  defined  in  equations  (5)  and  (6) 


respectively 


^EXP 


the  exponential  mean  = x,  where  x is  the 
sample  mean  (equation  (10)) 


The  results  of  the  percentage  error  in  the  mean, 
which  are  summarized  in  Table  III,  show  that  the  error  in 
MTTR  is  very  small.  All  cases  have  an  error  less  than  10% 
and  the  average  error  is  less  than  2.5%.  The  matter  of 
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TABLE  III 


Percentage  Error  in  MTTR  when  Assuming 
an  Exponential  Distribution 


Set 

No. 

Sample 

Mean 

tMEXPJ 

mlgn 

E(%) 

(1) 

(2) 

(3) 

1 

18.7 

18.3 

2.0 

2 

25.4 

25.1 

0.9 

3 

20.43 

20.43 

0.06 

4 

78.1 

81.0 

3. 5 

5 

11.1 

11.3 

1.4 

6 

28.5 

29.0 

1.8 

7 

22.4 

22.6 

0.9 

8a 

20.2 

20.3 

0.6 

8b 

70.7 

71.7 

1.5 

9 

56.2 

53 . 1 

5.9 

10a 

17.4 

16.4 

6.2 

10b 

20.3 

20.9 

0.22 

11 

10.0 

9.3 

6.7 

12 

11.5 

11.2 

2.8 

13a 

48.2 

48.3 

0.24 

13b 

72.3 

72.1 

0.35 

14a 

50.4 

54.7 

7.8 

14b 

154.0 

155.7 

1.1 

15 

52.0 

54.3 

4.2 

16 

19.0 

19.3 

1.5 

17 

17.0 

19.9 

- 

18a 

41.6 

42.9 

2.9 

18b 

43.3 

44.1 

2.0 

19 

32.4 

32 . 5 

0.4 

convenience  in  using  the  sample  mean,  instead  of  the  log- 
normal mean,  despite  the  error,  is  easily  justified. 

2.  Percentage  Error  in  Median  and  Upper  Percentiles 
of  the  Lognormal  Distribution 

a.  Error  Caused  when  Assuming  an 

Exponential  Distribution 

From  Table  IV,  the  average  percentage  error  on 
the  50th,  90th  and  95th  percentiles-,  when  calculated  based 
on  an  exponential  distribution  instead  of  a lognormal  dis- 
tribution, is  greater  the  higher  the  percentile.  The 
average  error  for  the  median  is  15%  with  a range  fx-om  3.7% 
to  61%.  The  average  error  for  the  90th  percentile  is  21% 
with  a range  from  1.6%  to  47%.  The  average  error  for  the 
95th  percentile  is  25%  with  a range  from  0.7%  to  65%. 

The  greater  the  probability  of  getting  the  test 
statistic  for  the  lognormal  distribution  (which  means  more 
appropriateness  of  the  lognormal  distribution),  the  greater 
the  error  is  when  assuming  an  exponential  distribution. 

This  result  is  important  in  particular  when  estimating  the 
median  and  maximum  allowed  corrective  repair  time  during 
a maintainability  demonstration. 

b.  Error  Between  Calculated  and  Estimated 

Parameters  from  Probability  Plot 

The  percentage  error  when  estimating  parameters 
of  the  lognormal  distribution  from  a lognormal  probability 
plot  instead  of  calculating  them,  is  relatively  small. 

From  Table  V it  can  be  seen  that  the  percentage 
error  in  the  median  is  less  than  10%  with  an  average  of  3%. 
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Percentage  Error  in  MediLn  and  Upper  Percentiles 
when  Assuming  an  Exponential  Distribution 
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In  the  upper  percentiles  the  percentage  error  is  higher,  but 
still  within  a reasonable  range.  In  one  third  of  the  cases 
the  error  is  more  than  10%  and  this  is  particularly  so  in 
which  the  lognormal  distribution  does  not  fit  the  data. 

From  these  results  it  can  be  concluded  that  the 
estimation  of  distribution  parameters  from  a probability 
plot  is  a convenient  and  sufficiently  accurate  method,  de- 
pending on  the  purpose  and  the  intended  use  of  such  esti- 
mated parameters. 

C.  EXTREME  VALUE  POINTS  IN  PROBABILITY  PLOTTING  S 


Most  of  the  plots  on  lognormal  probability  paper  resulted 
in  some  departures  from  the  straight  line  which  was  drawn  as 
a linear  fit  to  the  plotted  data  points,  especially  at  the 
extreme  values.  While  deviations  in  the  central  part  of 
the  line  (between  the  first  and  third  quartiles),  can  be 
! attributed  to  randomness  and  inaccuracy  (round-offs)  of 

I 

measurements  and  plotting,  the  deviations  of  the  extreme 
value  points  require  some  additional  explanation. 

The  greatest  expected  deviations  are  those  points  at 
the  higher  level  which  end  up  below  the  straight  line.  One 
reason  for  this  is  truncation  of  tests  once  the  repair  time 
becomes  too  long  during  the  demonstration  test,  and  as  a 
result  the  repair  time  is  estimated.  On  the  other  hand, 


in  the  field  it  can  be  expected  that  the  actual  repair  time 


The  reasons  for  the  deviations  of  the  lower  extreme 
value  points  below  the  line  are  probably  imprecise  measure- 
ments of  short  times. 

The  deviations  above  the  line  might  be  explained  as 
special  cases  in  which  there  are  inexperienced  technicians 
during  the  demonstration  and  as  a result  some  repair  times 
become  longer  than  expected. 

Although  these  deviations  are  taken  into  account  while 
fitting  a straight  line  to  plotted  data  points,  they  have 
more  significant  effect  on  the  results  of  the  tests  for 
distributional  assumptions.  In  some  cases  extreme  points, 
usually  those  which  were  of  totally  different  magnitude 
from  the  rest  of  the  data  points,  were  removed  in  order  to 
determine  their  effect  on  the  results.  Indeed,  some  of 
these  cases  resulted  in  a "better"  test  statistic.  However, 
the  results  of  the  statistical  tests  are  based  on  the 
original  data,  including  extreme  value  points,  except  for 
some  cases  discussed  in  Section  VA2. 


79 


VI . CONCLUSIONS 


A.  SUMMARY  AND  CONCLUSIONS 


The  conclusions  derived  from  this  study  may  be  divided 


into  (1)  conclusions  concerning  the  results  of  the  data 


analysis,  and  (2)  conclusions  related  to  the  methods  used 


for  testing  and  analyzing  the  data  and  their  results. 


1.  From  the  data  analysis  conducted  in  this  study,  it 


is  concluded  that  the  lognormal  distribution  is  a good  de- 


scriptor of  the  distribution  of  corrective  maintenance  re- 


pair time.  Sixteen  of  the  24  sets  from  maintainability 


demonstrations  of  radically  different  designs  tend  to  show 


that,  within  an  acceptable  level  of  significance,  this 


assumption  cannot  be  rejected.  Similarly,  the  data  analy- 


sis shows  that  the  assumption  of  an  exponential  distribu- 


tion should  be  rejected  in  17  sets. 


2.  The  percentage  error  in  the  MTTR  when,  assuming  an 


exponential  distribution  instead  of  a lognormal  distribu- 


tion, as  a matter  of  convenience,  for  calculating  system 


availability  has  been  found  to  be  small.  Other  than  the 


one  case  in  which  the  exponential  distribution  assumption 


would  not  be  rejected  and  the  lognormal  distribution  assump- 


tion would,  all  cases  have  an  error  less  than  10%  and  thus 


would  not  have  any  significant  effect  on  availability. 


3.  The  methods  used  in  the  analysis,  probability  plot- 


ting and  statistical  tests  for  distributional  assumption, 
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complement  one  another.  When  the  results  of  the  statisti- 
cal test  indicated  opposite  conclusions,  the  probability 
plot  or  a histogram  were  helpful  in  determining  the  "cor- 
rect" core  fusion.  Since  there  are  differences  among  the 
sets  of  data  and  their  accuracy,  a single  method  of 
analysis  is  usually  not  sufficient. 

4.  The  differences  in  the  level  of  significance  which 
resulted  from  the  chi-squared  test  and  the  W test,  can  be 
attributed  to  the  difference  in  computing  the  test  statis- 
tics in  each  test.  Points  from  the  sample  data  which  do 
not  follow  the  assumed  distribution  will  have  different 
effects  on  the  chi-squared  test  and  the  W test.  The  result 
of  the  test  is  also  a function  of  both  the  mean  and 
standard  deviation  estimated  from  the  sample  because  these 
values  are  used  in  the  calculation  of  the  test  statistic, 
although  differently  for  each  test. 

5.  Histograms,  frequently  used  by  seme  investigators, 
were  found  to  be  helpful  when  the  results  of  the  statisti- 
cal tests  were  close.  But  in  a histogram  there  is  often  a 
loss  of  information.  It  can  be  used  only  when  there  is  a 
need  to  get  insight  on  the  shape  of  the  distribution  of  the 
data. 


6.  Probability  plots  were  found  to  be  very  useful  in 
determining  the  suitability  of  a particular  distribution 
and  estimating  its  percenti~.es,  and  sometimes  density  para- 
meters. They  might  be  considered  old  fashioned  in  today's 
automated  and  computerized  world.  But,  it  is  a very  quick 
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and  simple  technique,  which  in  addition  to  or  in  place  of 
numerical  methods  of  data  analysis,  can  serve  several  pur- 
poses. In  maintainability  prediction  and  demonstration, 
the  value  of  plotted  data  is  quite  significant.  Estimation 
of  distribution  percentiles  and  parameters  is  easily  ob- 
tained from  the  straight  line  drawn  on  the  plot.  The 
average  error  in  doing  so  is  very  small.  Non-random  depar- 
tures of  the  plotted  data  from  a straight  line  can  provide 
useful  engineering  information.  Such  departures  may  indi- 
cate the  inadequacy  of  an  assumed  model,  which  implies 
that  the  parameters  required  to  be  tested  might  be  wrong. 

It  also  may  indicate  that  certain  data  points,  such  as 
extreme  value  points,  do  not  follow  the  pattern  of  the  resc 
of  the  data.  Engineering  insight  can  be  gained  when  the 
reason  for  such  deviations  is  determined. 

B.  RECOMMENDATIONS  FOR  CONTINUED  RESEARCH 

As  regards  continued  research,  five  areas  of  special 
interest  are  recommended.  The  first  one  is  the  determina- 
tion of  expected  ranges  of  the  mean  time  to  repair  and  other 
principal  distribution  parameters  for  different  classes  of 
equipment.  Although  this  was  one  of  the  objectives  of  this  , 
study,  because  of  the  small  number  of  data  sets  obtained 
for  similar  systems  and  the  need  for  further  investigation 
of  the  nature  of  the  systems,  it  was  not  possible  to  make 
such  a determination  at  this  stage. 

The  second  area  is  related  to  the  difference  between  the 
chi-squared  goodness-of-f it  test  and  the  W-test,  from  a 
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theoretical  standpoint.  The  reasons  behind  such  differ- 
ences, which  sometimes  gave  opposite  results,  should  be 
investigated  in  order  to  determine  the  appropriateness  of 
each  test  method  in  different  cases. 

The  third  area  is  also  related  to  the  results  of  this 
study.  It  is  the  investigation  of  those  cases  in  which 
the  lognormal  distribution  was  rejected  in  order  to  dis- 
cover the  underlying  reasons  therefore. 

The  last  two  recommended  areas  are  related  to  differ- 
ent type  of  systems.  Namely,  the  fourth  area  is  mechani- 
cal equipment  repair  times,  an  area  in  which  maintain- 
ability demonstration  data  were  not  obtainable.  In  this 
case  the  remove/replace  or  repair  actions  may  be  of  sig- 
nificantly larger  magnitude  than  diagnostic  time,  and  the 
lognormal  distribution  assumption  may  not  be  valid.  The 
last  area  is  related  to  the  increasing  use  of  digital 
techniques  in  electronic  equipment  with  increasing  use  of 
automatic  fault  detection  and  built-in  test.  Coupled  with 
the  increasing  use  of  microelectronics,  the  reduction  in 
diagnostic  and  repair  times  may  show  MTTR's  of  smaller 
magnitude  that  appear  to  be  exponential  due  to  the  limita- 
tions in  taking  small  time  observations.  Here,  again,  the 
validity  of  the  lognormal  assumption  should  be  verified. 
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APPENDIX  A 

MAINTAINABILITY  DEMONSTRATION  TEST  METHODS 
(Methods  4,8,9  in  Appendix  B of  MIL-STD-471A) 

1.  General 

Appendix  B of  MIL-STD-471A  [Ref.  3]  contains  test  methods 
and  criteria  for  demonstrating  the  achievement  of  specified 
quantitative  maintainability  requirements. 

2 . Application 

Table  VI  summarizes  the  major  characteristics  of  the  most 
used  test  methods  for  the  median  or  mean-time-to-repair  and 
the  allowed  maximum  repair  time  (usually  the  90th  or  95th 
percentile  of  the  distribution).  Each  test  method  provides 
an  equation  or  other  directions  for  determining  a minimum 
sample  size  of  maintenance  tasks  and  it  also  provides  deci- 
sion criteria  for  acceptance  or  rejection  of  the  item  being 
demonstrated. 

3.  Test  Methods 

The  concept  of  maintainability  demonstration  is  based 
on  the  assumption  that  a sample  of  maintenance  tasks  corre- 
sponds to  those  expected  in  the  field  during  the  operating 
life  of  the  system  and  can  be  used  to  make  an  assessment 
from  the  parameters  measured  in  the  sample. 

This  sample  must  be  obtained  in  accordance  with  test 
procedures  designed  to  ensvre  that  the  measures  obtained  are 
representative  of  the  stated  population  of  maintenance  tasks, 
that  the  variables  are  adequately  described  and  their  units 
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of  measurements  are  independent,  and  that  the  test  plan  is 
sufficiently  flexible  to  encompass  variations  in  test  con- 
ditions and  schedules  and  is  realistic  in  terms  of  existing 
constraints  and  the  capability  of  test  personnel  [Ref.  8], 

Appendix  A of  MIL-STD-471A  outlines  a procedure  for  the 
selection  of  a sample  of  corrective  maintenance  tasks  for 
maintainability  demonstration  when  the  tasks  result  from 
failure  simulation.  The  objectives  of  this  procedure  are 
to  allow  for  the  selection  of  maintenance  tasks  such  that 
the  selection  simulates  the  failure  frequency  of  the  test 
unit  in  actual  operation,  and  to  insure  that  a proportion- 
ately representative  sample  of  task  types/times  are 
selected.  The  sequential  test  method  (Test  Method  8) 
employs  simple  random  sampling. 

The  following  is  a brief  description  of  the  test 
methods . 

(a)  Test  Method  4 - Test  on  the  Median  (ERT) 

(Test  Method  3 in  MIL-STD-471) 

This  method  is  used  when  the  requirement  is  stated  in 
terras  of  an  Equipment  Repair  Time  (ERT),  which  is  the 
median  specified  in  the  detailed  equipment  specification. 

The  decision  rule  states  that  the  equipment  under  test 
is  considered  to  have  met  the  required  ERT  when  the 
measured  mean-time-to-repair  (MTTR^)  and  standard  deviation 
(S),  as  determined  in  Appendix  B of  MIL-STD-471A,  satisfy 
the  expression 

Log  MTTRG  < Log  ERT  + 0.397(S) 
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The  specified  ERT  in  the  equipment  specification  should 
be  determined  using  the  expression 

ERT  (specified)  = .0.37  ERTmax 


where 

ERT_  = the  maximum  value  of  ERT  that  should  be 
max 

accepted  no  more  than  ten  percent  of  the  time. 

0.37  = a value  resulting  from  application  of 

"student's  t"  operating  characteristics  for  a 
sample  size  of  20  at  a five  percent  level  of 
significance  and  assuming  a population  standard 
deviation  of  0.55. 

(a  probability  of  0.05  of  rejecting  a system 
having  a true  MTTRq  equal  to  the  specified  ERT 
as  a result  of  one  test). 

(b)  Test  Method  8 - Test  on  a Combined  Mean/Percentile 
Requirement  (Test  Method  1 in  MIL-STD-471) 

This  method  is  used  when  the  specifications  are  in 
terms  of  a dual  requirement  for  the  mean  and  either  the 
90th  or  95th  percentile  of  maintenance  times  when  the  dis- 
tribution is  lognormal. 

It  is  assumed  that  the  mean  is  greater  than  100  units 
of  time,  the  ratio  of  the  90th  percentile  to  the  mean  is 
less  than  two,  and  the  ratio  of  the  95th  percentile  to  the 
mean  is  less  than  three. 

The  accept/reject  criteria  for  the  values  of  the 
required  mean,  (90th  or  95th  percentile)  are  defined 
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in  three  separate  plans/tables.  The  number  of  observations 
greater  than  and  less  than  the  required  value  are  accumu- 
lated separately  and  compared  to  the  decision  values  shown 
in  the  tables.  For  example,  for  a sample  size  of  50  the 
accept  criterion  is  if  the  number  of  observations  less  than 
the  specified  mean  is  11  and  less  than  the  specified  90th 
percentile  is  one.  The  reject  criterion  is  if  the  number 
of  observations  greater  than  the  specified  mean  is  19  and 
greater  than  the  specified  Mmov  is  four  for  the  90th  per- 
centile  or  three  for  the  95th  percentile. 

When  an  accept  decision  for  one  of  the  parameters  is 
reached,  only  the  test  for  the  second  parameter  should  con- 
tinue. The  equipment  is  rejected  when  a decision  to  reject 
either  parameter  occurs  regardless  of  the  status  of  the 
other  parameter. 

If  no  accept  or  reject  decision  is  made  after  100  ob- 
servations, the  following  rule  applies: 

Mean  - Accept  only  if  29  or  less  observations  are  more 
than  the  value  of  the  required  mean. 

(90th  percentile)  - Accept  only  if  5 or  less  ob- 

IUOA 

servations  are  more  than  M specified. 

max 

M_av  (95th  percentile)  - Accept  only  if  2 or  less  ob- 

Iucwv 

servations  are  more  than  Mfflax  specified. 

(c)  Test  Method  9 - Test  for  Mean  Maintenance  Time 
(corrective,  preventive,  and  combination  of 
corrective  and  preventive)  and  M (Test  Method 
2 in  MIL-STD-471)  ma 

This  method  is  applicable  to  demonstration  of  Mean 
Corrective  Maintenance  Time  (u  ),  Mean  Preventive 

V/ 
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Maintenance  Time  (p  ),  Mean  Maintenance  Time  (includes  pre- 
ventive and  corrective  maintenance  actions ) (np^c ) , and  Mmax 
(90th  or  95th  percentile  of  the  repair  time). 

The  procedures  of  this  method  for  demonstrating  yc  are 
based  on  the  Central  Limit  Theorem.  The  minimum  sample  size 
is  30,  but  the  actual  sample  size  should  be  determined  for 
each  equipment  demonstrated.  The  procedure  for  demonstrat- 
ing M is  valid  for  those  cases  where  the  underlying  dis- 
max 

tribution  of  corrective  maintenance  times  is  lognormal. 

The  accept/reject  criteria  are  one  tailed  confidence 
levels  for  specified  level  of  consumer  risk. 
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THE  EXPECTED  VALUE  OF  ORDERED  OBSERVATIONS 
FOR  PROBABILITY  PLOTTING 


The  principle  of  probability  plotting  requires  the 
plotting  of  the  ordered  observations  versus  their  "expected 
values" . Probability  papers  are  designed  such  that  the 
ordered  observed  values,  when  plotted  against  their  ex- 
pected values,  would  lie  on  an  approximate  straight  line 
through  the  origin  with  slope  equals  to  one.  The  origin 
and  slope  of  the  plot  will  change  if  the  variable  is  linear- 
ly transformed  for  plotting  convenience,  but  the  plot  will 
still  result  in  a straight  line  [Ref.  12] . 

Let  f(x)  be  the  probability  density  function  and  F(x) 
be  the  cumulative  distribution  function  of  a population  from 
which  a large  number  of  samples  of  size  n are  selected. 

Let  x^  be  the  value  of  the  i-th  smallest  observation  in 
a particular  sample. 

Because  xi  is  a random  variable,  its  value  fluctuates 
from  one  sample  to  the  next  according  to  some  probability 
distribution  whose  expected  value  E(x.  ),  can  be  shown  to 

1 , U 

be  equal  to  [Ref.  4]: 


L 

E<xi,n> = (irnfkrnr  J vr<xi>ll~1[1-F<xi>>n~i  d'p<V: 


where 


i=l,2, . . . ,n;  -®  < x.  < ® and  x.  < x.^.  for  all  i, 

i i — l+l 


m 


•v_. 


*w  -**~r  -VJ  ''  V ' 

i»~ jvraA. 


For  distributions  for  which  E(x.  ) cannot  be  determined 

i , n 


exactly,  the  following  approximation  can  be  used: 

i=l,2, . . . ,n 


«*i,n>  ’ F_1  [^k]  ■ 


where 


-If.  .i=c.1  i 

|n-2c+lj  1 


is  the  value  of  x,  such  that 


x 


F(x) 


■/ 


f(y)dy  = 


l-C 


n-2c+l 


Thus,  ECx^  q)  is  the  F(x)-th  fractile  of  the  distribu- 


tion, and  c is  a number  which  depends  on  n and  f(x)  [Ref.  4] . 

The  valu?  of  c = J,  as  suggested  in  References  4 and  11, 
was  used  in  this  study.  This  value  of  c has  been  found 
generally  acceptable  for  a wide  variety  of  distributions 
and  sample  sizes.  However,  the  use  of  c=0  has  also  been 
suggested  in  some  related  works  [Ref.  12] . 
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APPENDIX  C 

TABLES  FOR  evaluating  w test  for  normality. 


-p 

HH  03 

M 0) 

> H 

w =£ 

# C 

<3J  *H 


60  r n O « - 55  X r 

«*•  -f  n nrl  « - O 2 O 

OOOOOOOOO 

cr>'nO»*rO*>3' 

v~  r*  »t  OO  M O N 'O 

r*  TNrj'^J'O— 

o' 0666660 

— ^ ^ n «-  «*  - O O 

06066000 
o VO  *A  00  #**  O ^ 

o ^ s — 

«o  — . 30  r"'  oo  *T 

—*  v*%  r*s  <“4  — « — • O O 

6 6 6 6 6 6 o 

— . oo  O o o 

vn  - vo  o -r  £ £ 

•r  -r  so  #**  r*  £J 

6666660 
v»  r*  <*  O 

irtPl-0(M5 

— vA  fO  ^ O 

6 6 6 6 6 6 

tn  v>  r»  »o  n <2 

p*r4n»<sO 
N ^ <*1  A ^ T 

— *S\  f-O  04  — O o 

6 6 6 6 6 6 

& us  n c* 

— OfAN^rvo 

— 

6 6 6 6 6 

?\  -*  *«  ’f 
_ <*-  C\  04  <* 

O p^  o4  — c* 

— n4  --  O 

6 6 6 6 6 


CO  ^ VO  f» 

co  *r  r-  ^ 
soriO'O' 
v'*  — O 


p<  VV  ^ f*'  'O  -O  ^ »«?w\3rt*S 

o'a6oooooooooocooo 

vA\a«r>*oo'At'»  — 

£ *.  ✓%  X OCX  - 

— c*c  *r  <<o  '■o  *t  r4  “’*  £ ?o  SSao 

066600000000000© 


AO'f 'O 
; O — c»  v. 


-'O'rt 
•n  O f» 
v*  Tf  cflafi 
^ 'O^O 

606 


r- 

t*  ;S2 

-O  *2 
. 60 


a !l?5Il5aiilsiil| 

Odoododdoooooooo 

a— 

Sa  #»i  f-«  r*  «r  ^ *T  C ^ «A  CO  50  V 

- ggss522228SS.3^5 

6000*  6 o’ OOOOOOOOO 

t-Ti-MO®"ia>:£rJ5E;3;Ei<S 

g 5sSS525E2llS3S3 

660606666000000 

?S5232SSS«1»k« 

=>,  ^j;«22^-oqoqo 

60666OOOOOOOOO 

?,?23K3P;SSgS5S| 

« 55S3222qSSSS38 

6666066OOOOOOO 

SSSSSSSSSSgSS 
S ;=Ss:--=qoQoo 
^ 0 ^ ^ ^ cj  o o o o o 

— 'S'C'oa£CJS»o! 

SO  ^O<A-M'A*''O50^^gS 

S *r  n *-r-:pqqoo 

6006600000000 

oc'‘^5oN5'2^'Tl2SS 

v-i  3 ^ >rri^x  ^ in*;22 

a 5SSS2--2qSoS 
006666000000 

*i30-r'/‘'r-.r4'nr*<art>r:£ 

o ? »oj  -r  © -»  -r  -?x  o £}  O 

2 ?SpiM---qqqqo 

O O O O O O O O O O O O 

pvj  sO  ^ ^ © *T  r*  £ S5 

-s  «r*  — v*  — o*  ^ 04  e\  £ jp 

3 ; - q q o o 

06660OOOOOO 

§S?;rS3;?2g2  3S 
a SJSSFjSZqS.SSS 

O66666OOOOO 

2 E 2 22  ? 3 3 ° 3 

£ i?  ^ ri 101 1- : — — .0  qq 
0066600000 

— -sv330^r:r:Cf2 

0060600000 

c<*. 

O «n-AO  'ONOJ^^J 

— 7 ^ pi  rq  - o o 9 

c’ 66660000 


-p)l<it'"«f»*2c2I-25! 


<*>?rom  Haim,  G.  J.  and  Shapiro  S.  S. , Statistical  Models,. in 
Engineering.  John  Wiley  and  Sons,  Inc.,  Hew  lork,  1967. 
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TABLE  VIII 


Percentage  Points  of  W Test  for  Normality 


It 

1 

2 

5 

to 

50 

3 

0.753 

0.756 

0.767 

0.789 

0.959 

4 

0.687 

0.707 

0.748 

0.792 

0.935 

5 

0.686 

0.715 

0.762 

0.806 

0.927 

6 

0.713 

0.743 

0.788 

0.826 

0.927 

7 

0.730 

0.760 

0.803 

0.838 

0.928 

S 

0.749 

0.778 

0.818 

0.S51  ' 

0.932 

9 

0.764 

0.791 

0.829 

0.859 

0.935 

10 

0.781 

0.S06 

0.842 

0.869 

0.933 

11 

0.792 

0.817 

0.850 

0.876 

0.940 

12 

0.805 

0.828 

0.859 

0.883 

0.943 

13 

0.814 

0.837 

0.866 

0.889 

0.945 

14 

0.825 

0.846 

0.874 

0.S95 

0.947 

15 

0.835 

0.S55 

0.881 

0.901 

0.950 

16 

0.844 

0.863 

0.887 

0.906 

0.952 

17 

0.851 

0.869 

0.892 

0.910 

0.954 

18 

0.S58 

0.874 

0.897 

0.914 

0.956 

19 

O.S63 

0.S79 

0.901 

0.917 

0.957 

20 

0.868 

0.884 

0.905 

0.920 

0.959 

21 

0.873 

0.388 

0.908 

- 123 

0.960 

22 

0.878 

0.892 

0.911 

0.926  ■ 

0.961 

23 

0.881 

0.895 

0.914 

0.928 

0.962 

24 

0.884 

0.898 

0.916 

0.930 

0.963 

25 

0.888 

0.901 

0.918 

- 0.931 

0.964 

26 

0.891 

0.904 

0.920  • 

0.933 

0.965 

27 

0.894 

0.906 

0.923 

0.935 

0.965 

28 

0.396 

0.908 

0.924 

0.936 

0.966 

29 

0.898 

0.910 

0.926 

0.937 

0.966 

30 

0.900 

0.912 

0.927 

0.939 

0.967 

31 

0.902 

0.914 

0.929 

0.940 

0.967 

32 

0.904 

0.915 

0.930 

0.941 

0.968 

33 

0.906 

0.917 

0.931 

0.942 

0.968 

34 

0.908 

0.919 

0.933 

0.943 

0.969 

35 

0.910 

0.920 

0.934 

0.944 

0.969 

36 

0.912 

0.922 

0.935 

0.945 

0.970 

37 

0.914 

0.924 

0.936 

0.946 

0.970 

38 

0.916 

0.925 

0.938 

0.947 

0.971 

39 

0.917 

0.927 

0.939 

0.9-8 

0.971 

40 

0.919 

0.928 

0.940 

0.949 

0.972 

41 

0.920 

0.929 

0 941 

0.950 

0.972 

42 

0.922 

0.930 

0.942 

0.951 

0.972 

43 

0.923 

0.932 

0.943 

0.951 

0.973 

44 

0.924 

0.933 

0.944 

0.952 

0.973 

45 

0.926 

0.934 

0.945 

0.953 

0.973 

46 

0.927 

0.935 

0.945 

0.953 

0.974 

47 

0.928 

0.936 

0.946 

0.954 

0.974 

48 

0.929 

0.937 

0.947 

0.954 

0.974 

49 

0.929 

0.937 

0.947 

0.955 

0.974 

50 

0.930 

0.938 

0.947 

0.955 

0.974 

3 -0.625  0.386  0.7500  27  -5.905  1.905  0.1980 

4 -1.107  0.714  0.6297  28  -5.988  1.919  0.1943 

5 -1.530  0.935  0.5521  29  .-6.074  1.934  0.1907 

6 -2.010  1.138  0.4963  30  -6.160  1.949  0.1872 

7 -2.356  1.245  0.4533  31  -6.248  1.965  0.1S40 

8 -2.696  1.333  0.4186  ■ 32  -6.324  1.976  0.1S11 

9 -2.968  1.400  ■ 0.3900  33  -6.402  1.988  0.1781 

10  -3.262  1.471  0.3660  34  -6.480  2.000  0.1755 

11  -3.485  1.515  0.3451  35  -6.559  2.012  0.1727 

12  -3.731  1.571  0.3270  36  -6.640  2.024  0.1702 

13  -3.936  1.613  0.3111  37  -6.721  2.037  0.1677 

14  -4.155  1.655  0.2969  38  -6.803  2.049  0.1656 

15  -4.373  1.695  0.2842  39  -6.887  2.062  0.1633 

16  -4.567  1.724  0.2727  40  -6.961  2.075  0.1612 

17  -4.713  1.739  0.2622  41  -7.035  2.088  0.1591 

18  -4.885  1.770  0.2528  42  -7.111  2.101  0.1572 

19  -5.018  1.786  0.2440  43  -7.188  2.114  0.1552 

20  -5.153  1.802  0.2359  44  -7.256  2.128  0.1534 

21  -5.291  1.818  0.2264  45  -7.345  2.141  0.1516 

22  -5.413  1.835  0.2207  46  -7.414  2.155  0.1499 

23  -5.508  1.848  0.2157  47  -7.484  2.169  0.1482 

24  -5.605  1.S62  0.2106  -7.555  2.183  0.1466 

25  -5.704  1.876  0.2063  -7.615  2.198  0.1451 

26  -5.S03  1.890  0.2020  ju  -7.677  2.212  0.1436 


APPENDIX  D 


COMPLETE  RESULTS  OF  DATA  ANALYSIS 
Set  No.  1 


AM/TRC-87 

COMMUNICATIONS 

TRANCEIVER 

SAMPLE  SIZE  N 

= 59  NO. 

OF  CELLS  K 

= 11 

SAMPLE  MEAN  = 

18.67  STANDARD  DEV  = 

24.82 

EXPONENTIAL 

LQGNCRMAL 

ERROR 

PARAM1 

0.05 

2.43 

PARAM2 

0.95 

MTTR 

13.67 

18.30 

2.04 

% 

50-TH  PERCNT 

12.94 

11.37 

13.82 

% 

9C-TH  PERCNT 

42.98 

39.70 

9.27 

% 

9 5-^H  P ERC  NT 

55.92 

56.57 

1.15 

% 

CHI-SQR  STAT 

24.34 

10.54 

DEG  OF  FPEED 

9 

8 

SIGNIF  LEVEL 

. 0.380E-02 

0.229E  00 

Set  No.  2 


-gpgrga/Tcate 


QUICK  REACT I ON  CAPABILITY  RACAR 


SAMPLE  SIZE  H 

= 20  NO. 

OF  CELLS  K 

= 4 

SAMPLE  MEAN  = 

25.35  STANDARD  DEV  = 

19.40 

EXPQNEMTI AL 

LOGNCRMAL 

ERROR 

PAR  AMI 

0.04 

3.01 

PARAM2 

0.43 

MTTR 

25.35 

25.12 

C.  91 

% 

5C-TH  PERCNT 

17.57 

20.23 

13.12 

% 

90-TH  0 ERCNT 

58.  37 

47.04 

24.09 

% 

95-Th  PERCNT 

75.94 

59.74 

27.12 

% 

CHI-SQR  STAT 

L0.40 

1.20 

DEG  OF  FREED 

2 

1 

SIGNIF  LEVEL 

0.55  2E-02 

0.273E  00 

W-TEST 

b2 

7.47 

s2 

3.23 

W STAT 

0.907 

SIGNIF  LEVEL 

0.06 

Cumutaiv*  P»rc*nUg» 


■< 


99 


Set  No.  3 

AN/GSA-51  SACK  UP  INTERCEPTOR  CONTROL  SYSTEM 


SAMPLE  SUE 

N = 90  NO, 

OF  CELLS  K 

= 18 

SAMPLE  MEAN  = 

= 20.43  STANDARD  DEV  = 

17.07 

EXPONENTIAL 

LOGNORMAL 

ERROR 

PARAM1 

0.05 

2.73 

PAR  AM  2 

0.57 

MTTR 

20.43 

20.42 

0.  06 

% 

50-TH  PERCNT 

14.16 

15.33 

7.64 

% 

90-TH  PERCNT 

47.  04 

4C.46 

16.28 

% 

9 5— TH  PERCNT 

61.21 

53.25 

14.94 

% 

CHI-SQR  STAT 

25.60 

7.60 

DEG  OF  FREED 

16 

15 

SIGNIF  LEVEL 

0.599E-01 

0.939E  00 

'if** 


Repair  Time  (min) 


SMvV£**>*-A 


Set  No.  5 


I 


i 


t 


? 


AN/T  PS  -39  (V)  RADAR  SURVEILLANCE  SYSTEM 


SAMPLE  SIZE 

N = 75  NQ. 

OF  CELLS  K 

= 15 

SAMPLE  MEAN 

= 11. 11  STANDARO  OEV  = 

3.62 

EXPGNENTI  AL 

LOGNORMAL 

ERROR 

PARAM1 

0.09 

2.34 

PAR  AM?. 

0.16 

MTTR 

11.11 

11.27 

1.39 

% 

5C-TH  PEF.CNT 

7.70 

10.38 

25.80 

% 

9C-TH  PERCN7 

25.  59 

17.45 

46.62 

% 

9 5-TH  P£RCNT 

33,29 

20.22 

64.66 

% 

CHI-SQR  STAT 

148.40 

62.80 

DEG  OF  FREED 

13 

12 

SIGNIF  LEVEL 

0.433E-24 

0.694E-08 

X2  Test 

for  Normality 

X2  STAT 

65.60 

DEG  OF  FREED 

12 

SIGNIF  LEVEL 

< 0.005 

1 


1 
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Set  No.  6 


AM/3949-GR  RADIO  FREQUENCY  AMPLIFIER 


SAMPLE  SIZE 

N = 38  NO. 

OF  CELLS  K 

= 7 

SAMPLE  MEAN  = 

« 28.49  STANDARD  DEV  = 

12.30 

EXPONENTIAL 

LOGNORMAL 

ERROR 

PAR AMI 

0.04 

3.24 

PAR AM 2 

0.25 

MTTR 

28.49 

29.01 

1.77 

% 

5C-TH  PERCNT 

19.75 

25.63 

22.95 

% 

9C-TH  3 ERCNT 

65.  61 

48.50 

35.28 

% 

95-*H  PERCNT 

85.36 

58.10 

46.93 

% 

CHI-SQR  STAT 

33.  11 

4.74 

DEG  OF  FREED 

5 

4 

SIGNIF  LEVEL 

0.359  E-05 

0.315E  00 

W-TEST 

b2 

8.63 

s2 

9.15 

ff  STAT 

0.943 

SIGNIF  LEVEL 

0.074 

106 
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Set  No.  7 

AN/ARC-164<V  ) RADIO  SET  - INTERMEDIATE  LEVEL 


, 

SAMPLE  SIZE 

1 

° 

1 in 
! 

1 

1 li 
» * 

NO.  OF  CELLS  K 

= 10 

• 

SAMPLE  MEAN  = 

= 22.44 

STANDARD  DEV  * 

11.56 

i 

EXPCNENTI  AL 

lqgncrmal 

ERROR 

t 

PA RAMI 

0.04 

2.97 

PAR  AM  2 

0.29 

1 

MTTR 

22.44 

22.65 

0.94  % 

50— TH  PERCNT 

15  .55 

19.59 

20.61  % 

1 

9C-TH  °ERCN  T 

51.  66 

39.09 

32.17  % 

• 

9 5— TH  PERC  NT 

67.21 

47.53 

41.40  % 

f 

CHI-SQR  STAT 

41.60 

11.20 

DEG  OF  FREED 
SIGNIF  LEVEL 


0 .16  IE-05 


0 • 130 E 00 


W-TEST 

^2 


S 

W STAT 


13.49 

14.21 

0.949 


SIGNIF  LEVEL 


0.06 


. Att.  j 


Sssn 


Set  No.  8a 


AN/ASN-131  AIRBORNE  NAVIG.  SYST.  - ORGAN  12 . LEVEL 


SAMPLE  SIZE 

N = 21  NO. 

OF  CELLS  K 

= 4 

SAMPLE  MEAN  = 

: 20.21  STANDARD  DEV  = 

14.78 

EXPONENTIAL 

LOGNORMAL 

ERRGR 

PAR  AMI 

0.05 

2.32 

PARAM2 

0.39 

MTTR 

20.21 

20.34 

0.61 

% 

5 0-TH  PERCNT 

14.01 

16.72 

16.21 

% 

90-TH  PERCNT 

46.  55 

37.30 

24.79 

% 

95— TH  PERCNT 

60.56 

46.31 

29.36 

% 

CHI-SQR  STAT 

10.43 

2.31 

DEG  OF  REED 

2 

1 

SIGNIF  LEVEL 

0.544E-02 

0.937E-01 

W-TEST 

b2 

s2 

W STAT 

SIGNIF  LEVEL 


7.40 

7.84 

0.944 

0.25 


issf 


Set  No.  8b 

r — — ■'  ■ 

AN/ AS  N-131  AIRBORNE  NAVIG.  SYST  . -^INTERNED.  LEVEL 
SAMPLE  SIZE  N = 21  NO.  OF  CELLS  K = 4 


IPLE  MEAN  = 

70.67 

STANDARO  DEV  = 

36  .06 

EXPGNENTI  AL 

LQGNCRMAL 

ERROR 

PARAM1 

0.01 

4.13 

PAR  AM 2 

0.28 

MTTR 

70.67 

71.73 

1.48  % 

TH  PERCNT 

48.99 

62.32 

21.40  % 

TH  PERCNT 

162.  73 

123.00 

32.30  % 

•TH  PERCNT 

211.71 

149.11 

41.98  % 

-SQR  STAT 

6.24 

0.14 

i OF  FREEO 

2 

1 

SIGNIF  LEVEL 

W-TEST 

i-2 


0.442E-01 


0.705E  00 


S 

W STAT 

SIGNIF  LEVEL 


5.50 

5.62 

0.978 

0.87 


Set  No.  9 


£ 


t 

l 


| 

r 


r 


! 


i 


* 


HARPOON  SHIP 

COMMAND  LAUNCH 

CONTROL  SET 

SAMPLE  SIZE  V 

= 44  NO. 

OF  CELLS  K 

= 8 

SAMPLE  MEAN  = 

56.25  STANDARD  DEV  * 

85.65 

EXPONENTIAL 

LOGNORMAL 

ERROR 

PARAM1 

0.02 

3.19 

PARAM2 

1.57 

MTTR 

56.25 

53.  11 

5.90 

5C-TH  PERCNT 

38.99 

24.26 

60.71 

9G-TH  PERCNT 

129.  52 

120.76 

7.26 

95-TH  PERCNT 

168.51 

190.22 

11.42 

CHI-SQR  STAT 

23.27 

10.91 

DEG  OF  FREED 

6 

5 

SIGNIF  LEVEL 

0.710E-03 

0.532E-01 

W-TEST 

b2 

62.2 

s2 

68.8 

W STAT 

0.904 

SIGNIF  LEVEL 

< 0.01 

£*j  * 

* 
f 

* 

i 

\ 114 


i 

i 


5 

l 

j 

i 

f 

J 


Set  No. 10a 


0EFENCE  COMM. 

SYST£M/ SCF  INTERFACE  SYSTEM 

-ON  LINE 

SAMPLE  SIZE  N 

1 = 25  NO. 

OF  CELLS  K 

= 5 

SAMPLE  MEAN  = 

17.40  STANOARO  DEV  = 

20.60 

EXPQNENTI  AL 

LOGNCRMAL 

ERROR 

PARAM1 

0.06 

2.45 

PAR  AM 2 

0.68 

MTTR 

17.40 

16.33 

6.24  % 

50-TH  PERCNT 

12.06 

11.63 

3.66  % 

9C-TH  PERCNT 

40.  06 

33.59 

19.29  % 

95-TH  PERCNT 

52.  13 

45.35 

14.95  t 

CHI-SQR  STAT 

12.40 

4.40 

OEG  OF  FREED 

3 

2 

SIGNIF  LEVEL 

0.6 13  £-02 

0.111E  00 

W/WE  TESTS 

b2 

15.05 

s2 

16.42 

W/WE  STAT 

0 . 018'  ' 

0.916 

SIGNIF  LEVEL 

0.05 

( * ^A  value  lower  than  the  "Lower  Point"  in  the  95%  Range 
which  indicates  non-exponent iality 


Repair  Time  (min) 


Set  No.  10b 


DEFENCE  COMM.  SYSTEM/SCF  INTERFACE  SYSTEM-OFF  LINE 


SAMPLE  SIZE  N = 

25  NO. 

OF  CELLS  K 

= 5 

SAMPLE  MEAN  = 20 

.84  STANDARD  DEV  = 

18.75 

EXP 

CNENTIAL 

LOGNORMAL 

ERROR 

PAR  AMI 

0.05 

2.72 

PAR AM2 

0.63 

MTTR 

20.84 

20.89 

0.22 

s 

50-TH  PERCNT 

14.45 

15.23 

5.17 

% 

90-TH  ° ERCNT 

47.  99 

42.18 

13.76 

% 

95-TH  PERCNT 

62.43 

56.28 

10.92 

% 

CHI-SQR  STAT 

6.00 

4.40 

DEG  OF  FREEO 

3 

2 

SIGNIF  LEVEL 

0.112E  00 

0.111E  00 

W/WE  TESTS 

b2 

14.54 

s2 

15.14 

W/WE  STAT 

* 

CO 

o 

• 

o 

0.96 

SIGNIF  LEVEL 

0.42 

A value  between  the  Lower  and 

Upper  Point 

of  the 

90% 

or  95%  Range,  which  indicates  exponentiality . 
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Set  No.  11 


USASATCOMA 

COMMUNICATION 

SUBSYSTEM  CONTINGENCY) 

i 

SAMPLE  SIZE 

N = 50  NO 

. OF  CELLS  K 

= 10 

jg 

SAMPLE  MEAN  = 9.97  STANDARD  DEV  = 

10.79 

i 

EXPONENTIAL 

LOGNORMAL 

ERROR 

| 

PARAMl 

0.10 

2.04 

1 

PARAM2 

0.40 

MTTR 

9.97 

9.34 

6.71  % 

50-TH  PERCNT 

6 .91 

7.66 

9.79  % 

| 

90TH  °ERCN  T 

22.  96 

17.18 

33.60  % 

9 5-TH  PERCMT 

29.87 

21.60 

38.28  % 

% 

'-f* 

CHI-SOR  STAT 

49.20 

20.80 

I 

DEG  OF  FREEO 

8 

7 

1 

■i 

SIGNIF  LEVEL 

0.582E-07 

0.408E-02 

Jl 

V' 

W TEST 

NORMAL 

1 

fv 

1 

1 

b2 

16.72 

2994.97 

* T 

S2 

19.45 

5704.80 

1 

W STAT 

0.859 

0.525 

1 

3* 

SIGNIF  LEVEL  < 0.01  < 0.01 


v-; 


Set  No.  12 


USASATCOMA  COMMUNICATION  SUBSYSTEM  ( NODAL  ) 


SAMPLE  SIZE  N = 50  NO.  OF  CELLS  K = 10 


SAMPLE  MEAN  = 

11.54  STANDARD  DEV  = 

10.46 

EXPONENTIAL 

LOGNORMAL 

ERROR 

PAR AMI 

0.09 

2.21 

PAR  AM2 

0.42 

MTTR 

11.54 

11.  22 

2.81  % 

5 0-TH  PERCNT 

3 .00 

9.10 

12.08  * 

90-TH  3 ERCNT 

26.  57 

20.38 

27.23  * 

95-TH  PERCNT 

34.56 

26.42 

30.82  % 

CHI-SQR  STAT 

23.80 

7.20 

DEG  OF  FREED 

8 

7 

SIGNIF  LEVEL 

0.344E-03 

0.408E  00 

W-TEST 

b2 

19.54 

s2 

20.58 

W STAT 

0.95 

SIGNIF  LEVEL 

0.06 
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Set  No.  13a 

CONTINENTAL  ADC-  GROUND  DATA  SYS.  (INHERENT) 


SAMPLE  SIZE 

N = 50  NO. 

OF  CELLS  K 

= 10 

SAMPLE  MEAN  = 

= 48.18  STANOARD  DEV  = 

36.52 

EXPQMENTI  AL 

LOGNORMAL 

ERROR 

PARAMl 

0.02 

3.64 

PARAM2 

0.48 

MTTR 

48.18 

4E.30 

0.24 

% 

50-TH  PERCNT 

33.40 

37.97 

12.05 

% 

9C-TH  PERCNT 

110.  94 

92.39 

20.08 

% 

9 5— TH  PERCN^ 

144. 33 

118.84 

21.45 

% 

CHI-SQR  STAT 

24.40 

10.80 

DEG  OF  FREEC 

8 

7 

SIGNIF  LEVEL 

0.196E-02 

0.148E  00 

W-TEST 

b2 

23.01 

s2 

23.57 

W STAT 

0.976 

SIGNIF  LEVEL 


0.58 


Set  No.  13b 


CONTINENTAL 

ADC-  GROUND 

DATA  SYS.  (ACHIEVED) 

sample  size 

N - 50  NO. 

OF  CELLS  K 

= 10 

SAMPLE  MEAN  = 

: 72.32  STANDARD  DEV  = 

42.00 

EXPCNENTI AL 

LOGNORMAL 

ERROR 

PARAM1 

0.01 

4.14 

PAR  AM2 

0.27 

MTTR 

72.32 

72.07 

0.35 

% 

5 0-TH  PERCNT 

50.13 

62.97 

20.39 

% 

90-TH  0 ERCNT 

166. 52 

122.58 

35.35 

% 

95-TH  PERCMT 

216.65 

148.02 

46.36 

% 

CHI-SQR  STAT 

52.00 

17.20 

DEG  OF  FREED 

8 

7 

SIGNIF  LEVEL 

0.16  8E-07 

0. 1626-01 

W-TEST 

b2 

12.57 

S2 

13.23 

W STAT 

0.9505 

SIGNIE  LEVEL 


0.067 
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Set  No.  14a 


STRATEGIC  AIR13MM.  GROUND  DATA  SYS.  (INHERENT) 
SAMPLE  SIZE  N = 37  NO.  OF  CELLS  K 


= 7 


SAMPLE  MEAN  = 

50.41  STANDARD  DEV  = 

35.54 

EXPONENTIAL 

LOGNORMAL 

ERROR 

PAR  AMI 

0.02 

3.61 

PAR  AM2 

0.78 

MTTR 

50.41 

54.68 

7.81  % 

50-TH  PERCNT 

34.94 

37.11 

5.85  % 

90-TH  oERCNT 

116. 06 

114.73 

1.16  % 

9 5— TH  PERCNT 

151.00 

157.94 

4.39  % 

CHI— SOR  STAT 

9.35 

3.68 

OEG  OF  PR  EEC 

5 

4 

SIGNIF  LEVEL 

0.958E-01 

0.452E  00 

W-TEST 

b2 

25.95 

s2 

» 

27.9 

W STAT 

0.93 

SIGNIF  LEVEL 


0.03 
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Set  No.  14b 
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STRATEGIC  AIRCOMM.  GROUND  DATA  SYS.  (ACHIEVED) 


SAMPLE  SIZE 

N = 37 

NO.  OF  CELLS 

K = 7 

SAMPLE  MEAN  = 

* 154.00 

STANDARD  DEV  = 

117.22 

EXPONENTIAL 

LOGNORMAL 

ERROR 

PAR AMI 

0.01 

4.77 

PAR AM 2 

0.55 

MTTR 

154.00 

155.  69 

1.09 

% 

50-TH  OERCN*r 

106.74 

118.10 

9.62 

% 

90-TH  PERCNT 

354.60 

306.30 

15.77 

% 

95-tH  PERCNT 

461.34 

401.18 

15.00 

% 

CHI-SQR  STAT 

10.49 

4.43 

DEG  OF  FREED 

5 

4 

SIGNIF  LEVEL 


0.626E-01 


0.351E  00 


W-TEST 

t.2 


S~ 

W STAT 


19.11 

19.91 

0.96 


SIGNIF  LEVEL 


0.26 


sf-v.', 


Set  No.  15 
SAMSG  46  FOOT  tt£c  ANTENNA 


SAMPLE  SIZE 

N = 50 

NO.  OF  CELLS  K 

= 10 

SAMPLE  MEAN  = 

* 52.04 

standarq  DEV  = 

44.44 

EXPONENTIAL 

LOGNORMAL 

ERROR 

PAR  AMI 

0.02 

3.62 

PAR  AM  2 

0.74 

MTTR 

52.04 

54.34 

4.24  % 

50-TH  P ERCNT 

36.07 

37.47 

3.74  % 

9C-TH  P ERCNT 

119. 83 

113.18 

5.87  % 

9 5-TH  PERCN"' 

155.90 

154.77 

0.73  % 

CHI-SQR  STAT 

19.20 

10.40 

DEG  OF  FREED 

8 

7 

SIGNIF  LEVEL 

W-TEST 

b2 

s2 

W STAT 


0.1386-01 


SIGNIE  LEVEL 


0 • 167 E 00 


35.82 

36.41 

0.984 

0.855 


1 


| 

I 

H 

1 


M 


| 

1 

s 


I 

d 

% 

I 

I 


MAOC  DIGITAL  TELEVISION 

PROJECTION 

UN  IT 

SAMPLE  SIZE 

M = 22  NO. 

OF  CELLS  K 

* 4 

SAMPLE  MEAN  = 

19.02  STANDARD  DEV  = 

8.73 

EXPONENTIAL 

LOGNORMAL 

ERROR 

PARAM1 

0.05 

2.83 

PARAM2 

0.25 

MTTR 

19.02 

19.31 

1.53 

% 

5 0-TH  PERCNT 

13.18 

17.02 

22.54 

% 

90-TH  PERCNT 

43.  79 

32.44 

35.00 

% 

95-TH  PERCNT 

56.97 

33.94 

46.31 

% 

CHI-SQR  STAT 

16.  18 

0.91 

DEG  OF  FREED 

2 

1 

SIGNIF  LEVEL 

0.3  06E-03 

0.340E  00 

W-TEST 

b2 

5.09 

s2 

5.31 

W STAT 

0.957 

SIGNIF 

LEVEL 

0.43 

Set  No.  17 


USASATCOMA 


HT/MT  terminal 


SAMPLE  SIZE 

N » 50  NO. 

OF  CELLS  K 

= 10 

SAMPLE  MEAN  = 

* 17.02  STANDARD  DEV  = 

17.40 

EXPONENTIAL 

lognormal 

ERROR 

PAR AMI 

0.06 

2.29 

PA1?  AM2 

1.39 

HTTR 

17.02 

19.87 

14.32 

% 

50-TH  PERCNT 

11.80 

9.90 

19.16 

% 

9C-TH  PERCNT 

39.  19 

44.95 

12.81 

% 

95— TH  DERCNT 

50.99 

68.99 

26.09 

Z 

CHI-SQR  STAT 

8.40 

20.00 

DEG  OF  FREED 

8 

7 

SIGNIF  LEVEL 

0.395E  00 

0 .557 E— 02 

W-TEST 

b2 

s2 

W STAT 


61.3 

68.6 

0.894 


SIGNIF  LEVEL 


< 0.01 


\ 

i 

i 

R 

I 

| 


s 

I 
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NATIONAL  MILCOM.  SYS.-GRCH 

SAMPLE  SIZE  N 

S 39  1 

SAMPLE  MEAN  * 

41.64 

EXPONENTIAL 

parami 

0.02 

PARAM2 

MTTR 

41.64 

50-TH  R ERCNT 

28,86 

90-TH  R ERCNT 

95.88 

95-TH  o ERCNT 

124.75 

CHL-SQR  STAT 

9.64 

DEG  OF  FREED 

5 

SIGNIF  LEVEL 

0.86  IE-1 

Set  No.  13a 

S. -GROIN Q DATA  SYS*  (IN HERB 

g NO.  OF  CELLS  K = 7 

4 STANDARD  DEV  = 33.60 

ential  lognormal  f£*0R 


3.43 

0.66 

42.88 

30.79 

87.40 

117.45 

9.64 

4 

0.469E-01 


2.88  % 
6.24  % 
9.70  % 
6.21  * 


W-TEST 

b2 

S2 

W STAT 
SIGNIF  LEVEL 


24.75 

25.19 

0.982 

0.85 


NATIONAL  MILCOM.  SYS. -GROUND  DATA  SYS.  (ACHIEVED! 


SAMPLE  SIZE 

N = 39  NO. 

OF  CELLS  K 

= 7 

SAMPLE  MEAN  * 

= 43.28  STANDARO  DEV  = 

34.73 

EXPONENTIAL 

LOG NORMAL 

ERROR 

PARAM1 

0.02 

3.48 

PARAM2 

0.62 

MTTR 

43.28 

44.15 

1.96 

50-TH  PERCNT 

30.00 

32.37 

7.33 

9C-TH  PERCNT 

99.  66 

88.86 

12.15 

9 5-TH  PERCNT 

129.66 

118.27 

9.63 

CHI-SQR  STAT 

11.08 

6.77 

DEG  OF  FREED 

5 

4 

SIGNIF  LEVEL 

0.499E-01 

0 • 149 E 00 

W-TEST 

b2 

23.15 

S2 

23.56 

W STAT 

0.983 

SIGNIF  LEVEL 

0.86 

141 
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Set  No.  19 

AUTOOIN  HEHCRy/ MEMORY  CONTROL  EQUIPMENT 
SAMPLE  SIZE  M = 33  NO.  OF  CELLS  K = 


SAMPLE  MEAN  = 

32.39  STANDARD  DEV  = 

25.48 

EXPONENTIAL 

LOGNORMAL 

ERROR 

PAR AMI 

0.03 

3.24 

PA  RAM  2 

0.48 

MTTR 

32.  39 

32.52 

0.39  % 

50-TH  PERCNT 

22.45 

25.57 

12.18  % 

90-TH  PERCNT 

74.  59 

62.22 

19.89  S 

95-TH  PERCNT 

97.04 

80.03 

21.26  * 

CHI—SQR  STAT 

10.45 

3.18 

DEG  OF  FREED 

4 

3 

SIGNIF  LEVEL 

0 .334E-Q1 

0.364E  00 

W-TEST 

^2 


S 

W STAT 


15.21 

15.39 

0.^88 


SIGNIF  LEVEL 


0.977 
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APPENDIX  E 


COMPLETE  EXAMPLE  OF  COMPUTER  PROGRAM  OUTPUT 
AN/GSA-51  BACK  UP  INTERCEPTOR  CONTROL  SYSTEM 


I 

REPAIR  TIME 

APPROX  F 

1 

3.00 

0.56 

2 

3.70 

1.67 

3 

4.20 

2.78 

4 

4.70 

3.89 

5 

5.00 

5.00 

6 

5.00 

6.  11 

7 

5.50 

7.22 

8 

5.60 

8.33 

9 

5.75 

9.44 

10 

5.80 

10.56 

11 

5.  80 

11.67 

12 

6.10 

12.78 

13 

6.30 

13.89 

14 

6.30 

15.  00 

15 

6.50 

16.11 

16 

6.  50 

17.22 

17 

6.  75 

18.33 

18 

7.50 

19.44 

19 

8.20 

20.56 

20 

8.20 

21.67 

21 

8.70 

22.78 

22 

8.75 

23.89 

23 

9.50 

25.00 

24 

9.50 

26.11 

25 

9.60 

2 7.22 

26 

9.90 

28.33 

27 

10.00 

29.44 

28 

10.  00 

30.56 

29 

10.10 

31.67 

30 

10.20 

32.78 

31 

10.20 

33.  89 

32 

10.60 

35.00 

33 

10.80 

36.11 

34 

11.  10 

3 7.  22 

35 

12.00 

38.33 

36 

12.00 

39.44 

37 

12.30 

40.  56 

38 

12.30 

41.67 

39 

12.70 

42.78 

40 

12.  70 

43.  89 

41 

13.00 

45.00 

42 

13.  50 

46.11 

43 

13.50 

47.  22 

44 

14.00 

48.33 

45 

14.30 

49.44 

46 

14.  80 

50.56 

47 

15.30 

51.67 

48 

16.30 

52.78 

49 

16.75 

53.39 

50 

16.90 

55.00 

51 

17.  80 

56.11 

52 

18.00 

57.22 

53 

18.00 

58.33 

54 

18.  10 

5 9.  44 

55 

18.30 

60.56 
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I REPAIR  time 

56  19.30 

II  19.50 

58  20.30 

59  21.00 

60  21. 20 

61  21.80 

6|  22. 10 

63  23. 00 

64  23.30 

65  23.  75 

66  24.00 

67  24.10 

68  25.  50 

69  26.25 

70  29.40 

71  29.50 

72  20. 00 

73  31.30 

74  31.  50 

75  32.30 

76  32.50 

77  34.50 

78  35. 40 

79  38.70 

80  39, 60 

81  40.00 

§2  40.10 

|3  49. 00 

84  52.20 

85  53.00 

86  59.00 

87  60.60 

88  68.20 

89  78. 90 

90  90.00 


APPROX  F(  I ) 

61.67 
6 2.  78 

63.89 

65.00 
66.  11 

67.22 

68.33 

69.44 

70.56 

71.67 
72.  73 

73.89 

75.00 

76.11 

77.22 

78.33 
79.  44 

80.56 

81.67 

82.78 

83.89 

85.00 

86.11 

87.22 

88.33 

89.44 

90.56 

91.67 

92.78 

93.89 
9 5.  00 
96.11 

97.22 
9 8.33 

99.44 
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CHI-SQUARE  COMPUTATION  FOR  : EXPONENTIAL 


NO.  OBS/CELL 


CHI-SQUARE  STATISTIC 
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CHI— SQUARE  COMPUTATION  FOR  : LOGNORMAL 


NO.  OBS/CELL 


3 

8 

6 

3 
5 
8 
5 
5 

4 

3 

5 
5 
5 

4 

5 

4 

5 
7 


CHI-SQUARE  STATISTIC 


0.30 
1.30 
0.20 
0.80 
0.00 
1.80 
0.00 
0.00 
0.20 
0.30 
0.  00 
0.00 
0.00 
0.20 
0.00 
0.20 
0.00 
0.30 
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AN/GSA-51 

BACK  UP  INTERCEPTOR  CONTROL 

SYSTEM 

, |ff 

SAMPLE  SIZE  N 

= 90 

NO.  OF  CELLS  K 

= 18 

SAMPLE  MEAN  = 

20.43 

STANDARD  DEV  = 

17.07 

EXPONENTIAL 

LOGNORMAL 

ERROR 

PARAM1 

0.05 

2.73 

0 ARAM 2 

0.57 

MTTR 

20.43 

20.42 

0.06 

% 

50-TH  3 ERCNT 

14.  16 

15.33 

7.64 

% 

90-TH  3 ERCNT 

47.04 

40.46 

16.28 

% 

95— TH  P ERCNT 

61.21 

53.25 

14.94 

% 

CHI-SOR  STAT 

25.60 

7.60 

DEG  OF  FREED 
SIGNIF  LEVEL 


16 

0.599E-01 


15 

0.939E  00 
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APPENDIX  F 

COMPUTER  PROGRAM  FOR  DATA  ANALYSIS 

The  program  makes  use  of  routines  from  the  International 
Mathematical  and  Statistical  Library  (IMSL),  which  NPS  Com- 
puter Center  users  are  authorized  to  use. 

The  description  of  the  function  and  parameters  of  the 
routines  is  given  in  the  IMSL  user's  manual  which  is  avail- 
able at  NPS  Computer  Center  [Ref.  29]. 

The  following  is  a list  of  the  routines  from  the  IMSL 
used  in  the  program: 

1.  VSORTA  - Sort  arrays  in  ascending  order. 

2.  GFIT  - Chi-squared  goodness-of-f it  test. 

a.  MCDFI  - Chi-square  probability  distribution 
function  (PDF). 

3.  USPC  - Print  and  plot  sample  and  theoretical  PDF 

with  95%  band  confidence  intervals. 

a.  VSMMMX-  Locates  the  Min  and  Max  values  of  a 

vector. 

b.  USPLH  - Printer  Plot. 

In  addition,  two  External  PDF's  are  defined: 

1.  REXP  - PDF  of  the  Exponential  distribution. 

2.  RLOG  - PDF  of  the  Lognormal  distribution. 

The  main  program  computes  the  following: 

i— 0 5 

1.  Expected  values  of  ordered  observations  ( — x 100). 

2.  Sample  mean  and  standard  deviation  based  on  the 
maximum  likelihood  estimates. 

o 

3.  The  parameters  of  the  lognormal  distribution  (u,cr  ). 
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4.  Calculated  50th,  90th,  and  95th  percentiles  under 
exponential  and  lognormal  distributions  assumptions. 

5.  Percentage  differences  between  the  calculated  para- 
meters of  the  exponential  and  lognormal  distribu- 
tions . 

Input  Formats 


Variable 

Name 

Cols. 

Format 

Description 

1 

NS 

1-2 

12 

Number  of  data  sets. 

2 

Title 

1-50 

50A1 

Name  of  system/equipment 
analyzed,  or  any  other 
identification.  The  con- 
tent of  this  card  is 
printed  out. 

3 

IN 

1-3 

13 

Number  of  observations  in 
the  data  set  analyzed. 

IK 

4-6 

13 

Number  of  equiprobable 
cells  in  the  data  set 
analyzed. 

4 

Data(I ) 
1=1, IN 

1-80 

8F10.5 

Each  card  contains  8 
observations.  Only  the 
last  card  can  be  less  than 
8,  depending  on  the  number 
of  observations  in  the 
data  set.  The  maximum 
number  of  cards  of  this 
type,  for  each  data  set, 
is  999. 

Cards  No.  2,  3,  and  4 are  repeated  in  this  order  for  each 
data  set. 
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DIMENSION  OAT A(240  ) , DCELLS ( 60 ) ,DC CMP (60 ) ♦ W A(2248,  1), 
1 T ITLE(  50) »F { 240)  ,NCEL(60)  ,DATX(240) 

COMMON  IN , IK, PMEAN, VAR, RLMEAN, RLV AR, F°E, FPL 
EXTERNAL  REXP  ,RLOG 


** 


K = 1,50  i 


RE  AO  IN  INPUT  OATA  ** 

REAO  (5.10)  NS 
FORMAT  (12) 

00  999  L = 1,NS 

REAO  (5,15)  (TITLE  ( K) 

FORMAT  (50A1) 

WRITE  (6,99) 

WRITE  (6,20)  (TITLE(K),  K = 1,50  J 
FORMAT  (*  0*  , 15X,  50A1) 

WRITE  (6,22) 

FORMAT  ( * 1 ,15X,50(  •-•)  ) 

REAC  (5,30)  IN,  IK 
FORMAT  (13,13) 

READ  (5,40)  (OATA(I)  ,1  = 1, IN) 
FORMAT  (8F10.5) 


10 


15 


20 

22 

30 


40 


CALL  VSORTA  (OATA, IN  ) 


**  COMPUTE  ANO  PRINT  ' EXPECTED  VALUES 
OF  ORDERED  OBSERVATIONS*  ** 

J60  = 55 
WRITE  (6,45) 


45 


48 


50 


FORMAT 
DO  50 
FJ  = J 
F(J)  = 
WRITE  ( 
FORMAT 
IF  ( J 
WRITE 
WRITE 


J60  = J60 
CONTINUE 


( *0*,26X,'  I* , 5X, ‘REPAIR  TI ME • ,5X , ' APPRCX  F(I)') 
J = 1 ,IN 

(FJ  - 0.5  )/  IN  * 100 
6,48)  J,OATA(  J)  ,F(  J) 

(*  • »25X,I3, 5X,F8.2,7X,F8.2) 

•LT.  J60  ) GO  TO  50 
(6,99) 

(6,45) 


+ 55 


**  COMPUTE  DISTRIBUTIONS  OARAMATERS  ** 

SUM  =0.0 

SUMS  = 0.0 

PMEAN  = 0.0 

VAR  = 0.0 

INI  = IN  - 1 

DO  60  J = 1 ,IN 

SUM  = SUM  + OATA(J) 

SUMS  = SUMS  -*•  DATA(J)**2 
60  CONTINUE 

PMEAN  = SUM  / IN 

VAR  = (SUMS/IM)  - (SUW**2)/(  IN* INI) 
STOV  * SQRT(  VAR  ) 

PMEANE  = 1/PMEAN 

VARE  = 1/ PMEAN 

SML  =0.0 

SMLS=  0.0 

RLMEAN  =0.0 

RLVAR  = 0.0 

CO  500  K = 1,  IN 

SML  = SML  + A LOG(OATA(K) ) 

SMLS  = SMLS  + ( ALOG(OATA(K )) )**  2 
500  CONTINUE 

INI  = IN  - 1 
RLMEAN  = SML  /IN 
RLVAR  = (SMLS/ INI 
PMEANL  = RLMEAN 
PVARL  = RLVAR 
STDVL  = S0RT(  PVARL) 

CMEANL  = EXP( PMEANL  + 0.5*PVARL) 


) - (SML  **  2)  / (IN  * INI  ) 
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**  COMPUTE  PERCENTAGE  ERROR  BETWEEN  EXP  ANO  LOGN  PARAM. 
PER50  a EXP(PMEANL) 

PER  SO  * EXP  (PMEANL  + i.282  * STDVL  ) 

PER95  = EXP  (PMEANL  + 1.645  * STOVL  ) 

PERE50  * -ALQG(0.50)  * PMEAN 
0 ER  E90  = -ALOG(O.IO)  * PMEAN 

PERE95  = -ALCGCO .05)  * PMEAN 
EMEAN  = ABS(  CMEANL  - PMEAN)  / CMEANL 


* 100 
* 100 
* 100 
* 100 


EPER50  = ABS  ( PER  50  - PERE50  ) / PER50 

EPER90  * ABS  (PER90  - PERE90  ) / PER90 

EPER95  = ABS  (PER95  - PE  RE  95  ) / PER95 

MN1  * 1 
MN9  =*  95 
MIP1  = 1 
MI  Cl  a 0 
IDFE  = 1 
IDFL  = 2 

PERFORM  CHI-  SQUARE  TEST  FOR  EXP  ASSUMPTION  ** 

CALL  GFIT  { REX  Pt  IK,  DAT  A»IN,DCELLS»  DC3MP  »DCSE»IDFE» 
1 XQE  , I ER) 

CO  600  K = 1,  IK 

NCcLCK)  = DC  ELLS  ( K ) 

600  CONTINUE 

WRITE  ( 6,  99 ) 

WRITE  (6,610) 

610  FORMAT  ( « 0‘  ,20X , • CH  I-SQUARE  COMPUTATION  FOR 
1 • EXPONENTIAL  •) 

WRI TE  ( 6,615) 

615  FORMAT  {'  ' ,20X,40(  •-•)  ) 

WRITE  (6,620) 

620  FORMAT  ( ' O' ,23X»‘  NO.  OBS/CELL' , 7X , • CHI-SQUAR £ », 

1 ‘STATISTIC1) 


625 

630 


640 


WRITE  (6,625) 

FORMAT  (‘  • ,23X,12( *-»)  ,7X,20(‘-‘ )) 
WRITE  (6,630)  ( NCELCK  ) ,DCOMP  (K) , K = 
FORMAT  ('0‘  ,2  3X , 12 , 16X  ,F6  .2) 

CO  640  I = 1,  IN 
CATX(I)  = OAT  A ( I ) 

CONTI.iuE 


1,  IK  ) 


**  PL CT  Of-  EXP  THEORETICAL  AND  SAMPLE  PDF  ** 

CAli.  USPC  (REXP,DATX  ,IN,MN1  ,MN9  , MI  PI , MI  Cl,  W A) 


PERFORM  CHI-SQUARE  TEST  FOR  LOGN  ASSUMPTION  ** 
CALL  GFIT  ( RLOS , I K ,DAT A, IN, D CELLS , C COMP, OCS L , 
1 XQL , I ER  ) 

CO  650  K = 1 , IK 
NCEL(K)  = OCELLS(K) 

CONTINUE 
WRITE  (6,99) 

WRITE  ( 6,655) 

FORMAT  COS 20X, 'CHI-SQUARE  COMPUTATION  FOR  : 

1 ' LOGNORMAL  ') 

WRITE  (6,615) 

WRITE  (6,620) 

WRITE  ( 6,625) 

WRITE  (6,630)  (NCEL(M)  ,DC3MP(M)  , V = 1,IK) 

CO  660  I = 1 , IN 
OATX(I)  = DATA!  I) 

660  CONTINUE 


I CFLi 


650 


655 
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*#  PLOT  of  LOGN  THEORETICAL  AMD  SAMPLE  PDF  ** 

CALL  USPC  (RL0G,DATX,IN,MN1,MN9,MIP1,MIC1,WA) 

**  PRINT  SUMMARY  TABLE  OF  RESULTS  ** 

WRITE  (6,100)  ( TITLE(K)  ,K  = 1,50  ) 

100  FORMAT  ( * O'  ,25X,  50A1) 

WRITE  (6,102) 

102  FORMAT  ('  « ,25X, 50 ( • -' ) ) 

WRITE  (6,  104)  IN, IK 

104  FORMAT  ('O'  ,25X, 'SAMPLE  SIZE  N = *,I3,5X,'N0.  OF', 

1 ' CELLS  K = ’ ,12) 

WRITE  (6.106)  PMEAN.STDV 

106  FORMAT  V O'  ,25X ,'  SAMPLE  MEAN  = • , F6  .2, 5X  , 'ST  ANOARD  ', 


1 'DEV  = • »F6.  2) 
WRITE  (6,110) 


110  FORMAT  ('O'  , 39X,  'EXPONENTIAL*  »4X  , • LC6N0RMAL ' , 5X, 

1 'ERROR') 

WRITE  (6,115) 

115  FORMAT  ('  * ,39X,1U'-'  ) ,4X,9('-')  ,5X,5('-'  ) ) 

WRITE  (6,125)  PMEAM  £, D MEANL 
125  FORMAT  (’ O' ,29X , • PARAM1 • , 7X , F6 .2, 3X, F6  .2 ) 

WRITE  (6.130)  PVARL 
130  FORMAT  ( ' O' , 29X,  'PARAM2',21X,F6.2) 

WRITE  (6,135)  PMEAN.CME  ANL,  EMEAN 
135  FORMAT  ( * O'  ,30X,  'MTTR  ' ,3X  »F  6.  2 * 8X,F6.2 ,6X,F5.2»*  V ) 
WRITE  (6,140)  PERE5  0,  PER50,  EP  ER5Q 
140  FORMAT  ( ' O' ,25X , « 50-TH  PERCNT' , 5X,F6.2 ,8X ,F6 .2,6X , 

1 F5.2, * ?») 

WRITE  (6,150)  PER£90,PER90,  EPER90 
150  FORMAT  ( ' O'  ,25X, ' 90-TH  PERCNT'  »5X  ,F6.2 ,8X  ,F6  .2,6X, 

1 F5.2, 1 %') 

WRITE  (6,160)  PERE95  ,PER95 , EPER95 
160  FORMAT  ( ' O' ,25X, ' 95-TH  PERCNT'  ,5X,F6.  2, 8X  ,F6.2,6X, 

1 F5.2,'  S') 

WRITE  (6,200)  DCSE , DCSL 

200  FORMAT  ( • O' , 25X, 'CHI-SQR  STAT* ,5X,F6.2, 8X,F6.2) 

WRITE  (6,210)  IOFE,  IOFL 

210  FORMAT  ( ’ O' ,25X, • DEG  OF  FREED* , 7X , 12  ,12X , 12 ) 

WRITE  (6,220)  XQE,  XOL 

220  FORMAT  ( ' O'  ,25X, ' S I GNIF  LEVEL • , 3X , Dll. 3, 3X , D 1 1.3 ) 
WRITE  ( 6,225) 

225  FORM  AT  (•  • ,42X,  9(  •- • ),  5X,9  ( *- • ) ) 

999  CONTINUE 

WRITE  (6,99) 

99  FORMAT  (•!•) 

RETURN 

END 

SUBROUTINE  REXP  ( XE,PE  ) 

COMMON  IN,  IK,  PM EAN ,VAR,°LMEAN,RLVAR,FP6,FPL 
PE  * 1 - EX  P (—X  E/  PMEAN  ) 

RETURN 

ENO 

SUBROUTINE  R LOG  ( XL, PL  ) 

COMMON  IN  , IK , PMEAN , VAR, RLMEAN, RLV  AR, FPE,FPL 
TX  = ( ALOG(XL)  - RLMEAN)  / S CRT  ( RLVAR) 

TX1  « TX  * 0.7071068 
PL  = 0.5  + 0.5  * ERFTX1) 

RETURN 

END 
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